-- Logs begin at Wed 2022-06-15 23:41:34 UTC, end at Thu 2022-06-16 00:52:50 UTC. -- Jun 16 00:17:43.665647 dv-cinder-843277-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 00:17:43.673393 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 00:17:43.675392 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 00:17:43 2022] *** Jun 16 00:17:43.675392 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 00:17:43.675392 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 00:17:43.675392 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: nodename: dv-cinder-843277-4-iscsi Jun 16 00:17:43.675392 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: machine: x86_64 Jun 16 00:17:43.675392 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: clock source: unix Jun 16 00:17:43.675392 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: pcre jit disabled Jun 16 00:17:43.675392 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: detected number of CPU cores: 4 Jun 16 00:17:43.675984 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: current working directory: / Jun 16 00:17:43.675984 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: detected binary path: /usr/bin/uwsgi-core Jun 16 00:17:43.675984 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: your processes number limit is 47680 Jun 16 00:17:43.675984 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: your memory page size is 4096 bytes Jun 16 00:17:43.675984 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: detected max file descriptor number: 2048 Jun 16 00:17:43.675984 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: lock engine: pthread robust mutexes Jun 16 00:17:43.675984 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: thunder lock: enabled Jun 16 00:17:43.677410 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 00:17:43.677529 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 00:17:43.720398 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: Python main interpreter initialized at 0x55f34a4909c0 Jun 16 00:17:43.720398 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: python threads support enabled Jun 16 00:17:43.720398 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: your server socket listen backlog is limited to 100 connections Jun 16 00:17:43.720398 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: your mercy for graceful operations on workers is 90 seconds Jun 16 00:17:43.720747 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 00:17:43.720825 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: *** Operational MODE: preforking *** Jun 16 00:17:43.721046 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: *** uWSGI is running in multiple interpreter mode *** Jun 16 00:17:43.721046 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: spawned uWSGI master process (pid: 114658) Jun 16 00:17:43.721239 dv-cinder-843277-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 00:17:43.722284 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: spawned uWSGI worker 1 (pid: 114659, cores: 1) Jun 16 00:17:43.722284 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: spawned uWSGI worker 2 (pid: 114660, cores: 1) Jun 16 00:17:43.722284 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 00:17:44.385584 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 00:17:44.386265 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 00:17:45.573339 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:17:45.573339 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: from cryptography.utils import int_from_bytes Jun 16 00:17:45.574032 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:17:45.574032 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: from cryptography.utils import int_from_bytes Jun 16 00:17:45.580931 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:17:45.580931 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: from cryptography.utils import int_from_bytes Jun 16 00:17:45.581383 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:17:45.581383 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: from cryptography.utils import int_from_bytes Jun 16 00:17:48.169165 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:17:48.169768 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:17:48.169923 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:17:48.170288 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:17:48.170400 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:17:48.171276 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:17:48.171347 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:17:48.171571 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.171687 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:17:48.171929 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.172018 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:17:48.172232 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:17:48.172318 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.172566 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.172737 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.172901 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.172989 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.173217 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.173303 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.173540 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.173627 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.173863 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.173948 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.174171 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.174261 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.174444 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.174529 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.174764 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.174860 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.175089 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-4-iscsi {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.175183 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.175351 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.175436 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.175691 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.175790 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.176015 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-4-iscsi {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.176109 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.176336 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.176421 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.176642 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.176728 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.176952 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.177053 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.177261 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.177357 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.177562 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.177762 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.178157 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.178282 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.178384 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.178508 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.178668 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.178824 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.178978 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.179182 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.179299 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.179480 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.179571 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.179823 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.179925 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.180146 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.180303 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.180460 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.180557 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.180813 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.180994 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.181134 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.181251 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.181424 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.181616 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-4-iscsi {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.181701 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.181826 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.182102 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-4-iscsi {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.182189 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.182415 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.182503 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.182724 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.182813 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.183033 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.183134 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.183422 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.183507 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.183755 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.183856 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.184063 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.184151 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.184381 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.184474 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.184702 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.184799 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.185008 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.185106 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.185332 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.185430 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.185645 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.185731 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.185950 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.186035 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.186264 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.186444 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.187156 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.187285 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.187481 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.187568 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.187822 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.187911 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.188136 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.188221 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.188393 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.188487 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.188709 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.188795 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.188998 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.189088 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.189308 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.189395 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.189630 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.189723 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.189914 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.189999 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.190171 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.190272 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.190495 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.190581 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.190745 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.190854 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.191065 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.191166 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.191381 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.191468 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.191710 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.191800 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.192020 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.192115 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.192330 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.192425 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.192636 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.192733 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.192940 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.193027 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.193243 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.193330 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.193550 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.193642 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.193854 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.193941 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.194171 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.194256 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.194481 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.194580 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.194798 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.194891 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.195103 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.195189 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.195421 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.195514 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.195772 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.195858 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.196078 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.196170 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.196383 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.196483 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.196719 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.196805 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.197034 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.197119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.197341 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.197448 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.197655 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.197749 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.197964 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.198049 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.198268 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.198353 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.198572 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.198659 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.198876 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.198962 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.199193 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.199288 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.199447 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.199538 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.199776 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.199865 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.200079 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.200164 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.200378 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.200477 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.200682 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.200767 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.200990 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.201089 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.201296 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.201399 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.201596 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.201694 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.201896 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.202006 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.202228 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.202312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.202532 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.202629 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.202836 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.202929 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.203140 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.203226 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.203445 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.203537 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.203770 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.203857 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.204074 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.204159 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.204380 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.204476 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.204682 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.204767 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.204984 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.205069 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.205299 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.205401 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.205603 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.205695 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.205907 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.205991 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.206210 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.206304 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.206514 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.206607 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.206816 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.206902 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.207122 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.207214 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.207423 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.207507 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.207754 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.207844 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.208073 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.208170 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.208378 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.208463 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.208683 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.208768 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.208989 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.209073 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.209294 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.209387 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.209598 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.209690 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.209906 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.209999 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.210203 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.210287 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.210507 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.210599 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.210822 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.210907 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.211128 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.211211 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.211437 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.211533 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.211761 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.211847 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.212073 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.212167 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.212373 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.212465 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.212676 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.212762 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.212977 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.213060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.213278 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.213370 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.213576 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.213662 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.213890 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.213974 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.214202 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.214293 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.214506 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.214589 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.214808 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.214900 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.215111 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.215205 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.215428 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:17:48.215513 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.215791 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.215890 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.216121 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.216249 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.216461 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.216594 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.216772 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.216932 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.217100 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.217257 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.217428 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.217600 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.217767 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.217921 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.218077 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.218252 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.218390 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.218571 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.218712 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.218889 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.219022 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.219206 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.219330 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.219534 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.219660 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.219887 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.219974 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.220223 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.220379 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.220546 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.220631 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.220870 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.220964 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.221182 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.221266 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.221500 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.221603 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.221805 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.221891 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.222123 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.222209 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.222447 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.222538 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.222759 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.222845 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.223067 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.223153 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.223399 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.223494 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.223761 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.223850 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.224073 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.224168 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.224395 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.224480 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.224707 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.224792 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.225016 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.225100 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.225341 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.225441 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.225632 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.225726 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.225951 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.226037 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.226267 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.226360 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.226573 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.226658 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.226887 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.226972 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.227196 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.227291 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.227503 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.227588 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.227834 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.227935 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.228144 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.228257 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.228453 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.228555 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.228784 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.228870 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.229095 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.229182 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.229406 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.229500 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.229714 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.229801 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.230027 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.230113 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.230338 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.230424 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.230647 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.230741 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.230954 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.231039 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.231254 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.231338 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.231561 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.231709 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.231884 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.231978 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.232195 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.232294 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.232493 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.232590 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.232809 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.232905 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.233131 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.233716 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.233952 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.234047 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.234282 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.234370 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.234586 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.234673 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.234898 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.234994 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.235210 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.235298 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.235520 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.235634 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.235857 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.235958 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.236169 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.236257 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.236476 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.236562 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.236777 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.236884 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.237100 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.237188 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.237406 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.237491 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.237707 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.237810 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.238024 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.238120 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.238324 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.238412 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.238627 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.238715 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.238937 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.239025 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.239245 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.239339 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.239553 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.239673 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.239884 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.239972 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.240191 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.240278 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.240509 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.240597 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.240821 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.240911 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.241131 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.241240 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.241459 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.241547 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.241766 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.241860 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.242076 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.242200 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.242400 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.242495 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.242714 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.242807 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.243022 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.243118 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.243321 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.243414 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.243642 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.243733 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.244200 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.244302 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.244503 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.244597 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.244803 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.244890 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.245106 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.245193 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.245402 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.245488 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.245703 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.245789 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.246004 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.246100 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.246304 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.246391 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.246602 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.246689 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.246919 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.247013 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.247225 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.247310 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.247522 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.247621 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.247845 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.247937 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.248148 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.248244 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.248483 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.248582 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.248799 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.248887 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.249647 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.249736 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.249981 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.250145 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.250295 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.250389 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.250617 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.250710 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.250925 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.251019 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.251237 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.251325 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.251546 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.251792 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.251883 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.251983 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.252175 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.252272 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.252490 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.252586 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.252800 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.252892 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.253108 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.253195 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.253424 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.253511 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.253732 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.253818 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.254049 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.254142 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.254355 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.254449 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.254664 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.254751 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.254964 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.255051 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.255276 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.255363 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.255631 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.255722 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.255957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.256043 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.256269 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.256358 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.256580 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.256680 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.256887 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.256980 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.257196 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.257291 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.257504 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.257597 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.257813 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.257900 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.258120 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.258220 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.258427 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.258514 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.258739 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.258823 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.259045 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.259139 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.259356 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.259442 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.259680 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.259770 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.260003 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.260107 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.260311 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.260448 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.260619 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.260714 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.260919 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.261006 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.261232 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.261370 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.261556 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.261645 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.261877 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.262013 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.262183 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.262277 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.262498 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.262586 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.262810 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.262909 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.263115 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.263210 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.263422 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.263509 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.263751 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.263842 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.264054 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.264153 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.264355 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.264451 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.264684 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.264772 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.264994 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.265081 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.265299 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.265396 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.265605 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.265692 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.265905 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.266003 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.266217 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.266313 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.266520 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.266606 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.266817 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.266902 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.267116 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.267217 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.267421 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.267508 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.267758 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.267848 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.268067 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.268201 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.268385 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.268473 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.268688 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.268773 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.268988 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.269075 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.269288 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.269376 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.269604 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.269692 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.269908 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.269995 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.270206 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.270326 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.270505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.270592 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.270804 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.270892 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.271141 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.271228 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.271445 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.271543 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.271765 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.271852 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.272079 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.272169 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.272396 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.272493 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.272706 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.272796 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.273016 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.273102 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.273320 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.273424 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.273629 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.273718 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.273944 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.274037 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.274253 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.274358 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.274560 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.274648 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.274867 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.274965 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.275173 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.275269 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.275479 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.275576 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.275809 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.275899 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.276126 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.276211 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.276431 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.276524 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.276738 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.276825 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.277042 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.277128 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.277341 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.277426 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.277646 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.277734 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.277959 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.278214 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.278514 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.278606 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.278852 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.278939 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.279170 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.279259 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.279489 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.279575 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.279832 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.279937 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.280664 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.280758 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.280996 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.281084 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.281325 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.281425 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.281647 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.281746 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.281960 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.282058 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.282268 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.282357 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.282572 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.282661 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.282875 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.283019 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.283180 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.283267 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.283482 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.283577 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.283809 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.283900 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.284113 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.284208 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.284417 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.284512 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.284717 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.284802 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.285019 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.285107 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.285322 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.285418 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.285625 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.285764 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.285929 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.286015 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.286227 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.286322 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.286533 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.286619 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.286833 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.286925 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.287150 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.287238 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.287457 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.287547 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.287780 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.287867 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.288083 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.288172 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.288385 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.288472 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.288722 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.288806 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.289024 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.289111 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.289360 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.289447 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.289687 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.289783 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.290012 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.290099 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.290317 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.290410 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.290620 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.290716 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.290942 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.291027 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.291240 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.291333 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.291541 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.291681 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.291868 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.291968 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.292177 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.292317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.292483 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.292578 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.292781 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.292873 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.293093 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.293178 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.293397 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.293484 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.293703 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.293792 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.294006 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.294092 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.294304 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.294398 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.294608 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.294695 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.294908 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.294995 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.295219 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.295314 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.295524 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.295636 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.295890 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.295997 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.296192 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.296280 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.296500 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.296588 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.296803 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.296898 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.297099 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.297193 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.297406 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.297532 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.297705 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.297802 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.298015 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.298110 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.298314 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.298408 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.298615 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.298710 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.298913 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.299000 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.299217 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.299304 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.299520 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.299651 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.299842 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.299929 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.300161 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.300247 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.300467 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.300571 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.300768 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.300856 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.301069 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.301156 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.301374 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.301463 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.301675 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.301762 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.301974 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.302061 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.302280 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.302412 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.302599 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.302687 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.302917 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.303011 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.303219 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.303311 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.303527 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.303641 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.303852 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.303951 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.304156 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.304243 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.304457 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.304544 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.304762 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.304856 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.305061 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.305160 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.305361 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.305448 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.305662 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.305757 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.305962 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.306057 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.306261 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.306349 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.306579 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.306676 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.306886 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.306973 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.307187 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.307273 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.307489 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.307588 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.307811 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.307898 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.308150 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.308238 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.308452 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.308539 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.308803 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.308889 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.309104 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.309189 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.309415 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.309503 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.309724 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.309810 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.310032 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.310118 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.310338 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.310426 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.310645 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.310731 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.310945 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.311032 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.311259 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.311891 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.312103 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.312191 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.312411 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.312507 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.312713 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.312799 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.313014 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.313102 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.313332 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.313428 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.313642 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.313728 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.313947 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.314041 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.314265 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.314364 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.314584 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.314671 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.314890 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.314983 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.315192 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.315286 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.315499 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.315586 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.315829 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.315918 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.316138 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.316230 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.316445 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.316533 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.316752 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.316846 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.317061 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.317156 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.317370 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.317458 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.317678 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.317765 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.317985 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.318081 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.318296 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.318383 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.318599 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.318692 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.318909 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.318997 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.319215 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.319310 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.319517 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.319639 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.319860 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.319947 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.320170 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.320255 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.320473 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.320570 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.320780 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.320865 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.321079 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.321165 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.321387 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.321482 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.321689 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.321815 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.322111 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.322206 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.322421 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.322526 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.322731 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.322823 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.323032 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.323162 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.323344 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.323440 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.323680 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.323800 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.323996 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.324100 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.324301 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.324410 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.324602 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.324723 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.325015 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.325104 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.325325 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.325430 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.325633 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.325722 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.325937 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.326023 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.326238 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.326327 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.326537 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.326624 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.326843 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.326965 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.327205 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.327291 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.327506 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.327591 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.327830 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.327934 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.328132 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.328220 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.328445 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.328585 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.328746 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.328842 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.329062 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.329173 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.329471 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.329566 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.329780 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.329876 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.330083 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.330197 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.330494 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.330591 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.330802 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.330891 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.331111 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.331198 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.331429 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.331515 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.331773 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.331864 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.332082 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.332168 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.332387 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.332483 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.332699 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.332785 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.333005 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.333092 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.333329 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.333426 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.333640 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.333737 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.333949 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.334037 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.334256 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.334341 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.334558 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.334645 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.334879 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.334967 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.335198 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.335284 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.335509 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.335606 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.335865 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.335953 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.336269 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.336355 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.336587 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.336690 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.336895 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.336984 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.337214 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.337302 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.337526 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.337621 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.337830 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.337927 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.338133 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.338220 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.338442 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.338545 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.338744 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.338829 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.339048 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.339135 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.339365 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.339453 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.339692 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.339793 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.340006 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.340101 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.340315 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.340403 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.340622 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.340708 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.340923 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.341016 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.341226 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.341315 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.341544 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.341639 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.341848 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.341937 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.342167 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.342254 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.342478 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.343077 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.343309 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.343455 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.343629 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.343719 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.343948 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.344046 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.344264 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.344364 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.344572 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.344666 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.344875 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.344963 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.345177 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.345273 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.345479 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.345566 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.345816 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.345902 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.346118 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.346213 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.346438 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.346537 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.346766 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.346862 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.347077 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.347164 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.347391 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.347477 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.347748 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.347851 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.348068 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.348155 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.348380 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.348473 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.348699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.348787 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.349005 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.349092 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.349312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.349406 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.349614 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.349702 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.349919 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.350013 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.350219 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.350312 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.350521 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.350682 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.350823 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.350912 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.351133 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.351223 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.351433 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.351528 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.351755 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.351865 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.352058 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.352146 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.352372 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.352467 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.352669 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.352755 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.352988 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.353077 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.353296 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.353395 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.353603 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.353689 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.353908 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.354005 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.354211 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.354307 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.354541 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.354628 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.354843 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.354938 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.355175 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.355264 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.355491 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.355580 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.355833 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.355944 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.356148 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.356237 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.356455 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.356571 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.356773 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.356861 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.357088 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.357184 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.357400 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.357496 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.357714 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.357883 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.358026 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.358114 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.358387 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.358484 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.358701 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.358797 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.359012 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.359098 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.359318 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.359405 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.359650 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.359754 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.359970 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.360069 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.360286 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.360489 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.360797 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.360894 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.361124 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.361212 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.361438 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.361527 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.361752 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.361848 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.362060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.362146 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.362372 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.362458 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.362681 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.362768 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.362990 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.363078 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.363300 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.363388 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.363628 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.363718 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.363947 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.364043 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.364272 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.364369 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.364591 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.364680 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.364914 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.365009 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.365231 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.365327 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.365548 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.365636 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.365860 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.365947 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.366173 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.366270 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.366485 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.366573 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.366832 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.366918 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.367143 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.367230 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.367447 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.367542 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.367779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.367882 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.368092 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.368181 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.368403 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.368491 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.368714 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.368812 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.369277 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.369368 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.369589 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.369684 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.369899 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.370000 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.370208 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.370353 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.370519 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.370607 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.370831 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.370928 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.371143 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.371232 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.371464 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.371560 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.371818 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.371909 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.372134 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.372229 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.372445 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.372531 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.372756 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.372844 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.373068 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.373274 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.373585 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.373718 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.374431 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.374530 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.374762 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.374851 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.375085 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.375182 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.375400 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.375488 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.375743 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.375835 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.376061 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.376161 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.376373 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.376467 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.376676 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.376763 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.376980 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.377076 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.377290 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.377378 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.377594 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.377682 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.377895 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.377991 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.378214 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.378302 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.378521 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.378606 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.378823 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.378910 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.379140 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.379228 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.379449 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.379699 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.380006 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.380096 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.380348 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.380443 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.380664 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.380760 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.380989 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.381078 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.381309 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.381395 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.381624 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.381717 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.381932 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.382020 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.382247 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.382333 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.382550 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.382645 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.382853 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.382948 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.383166 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.383261 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.383472 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.383656 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.383784 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.383869 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.384094 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.384182 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.384404 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.384548 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.384710 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.384797 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.385009 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.385095 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.385317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.385413 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.385616 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.385702 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.385939 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.386024 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.386240 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.386328 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.386543 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.386630 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.386846 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.386936 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.387149 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.387243 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.387449 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.387535 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.387772 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.387862 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.388078 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.388178 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.388379 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.388468 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.388687 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.388775 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.388988 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.389078 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.389295 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.389400 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.389644 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.389743 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.389953 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.390041 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.390255 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.390343 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.390561 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.390662 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.390904 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.390991 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.391217 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.391304 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.391520 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.391638 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.391845 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.391973 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.392158 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.392274 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.392468 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.393494 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.393494 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.393642 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.393717 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.393797 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.393797 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.393928 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.394007 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.394086 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.394165 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.394245 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.394529 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.394671 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.394864 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.394953 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.395184 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.395272 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.395520 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.395638 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.395856 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.395944 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.396165 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.396252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.396467 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.396555 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.396771 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.396903 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.397095 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.397193 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.397404 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.397536 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.397714 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.397811 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.398025 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.398123 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.398336 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.398431 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.398642 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.398728 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.398951 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.399047 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.399260 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.399353 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.399569 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.399674 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.399901 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.399989 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.400212 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.400302 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.400521 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.400608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.400827 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.400923 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.401134 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.401222 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.401446 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.401534 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.401783 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.401871 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.402099 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.402193 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.402411 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.402506 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.402723 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.402811 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.403034 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.403128 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.403343 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.403439 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.403675 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.403814 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.403990 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.404078 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.404297 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.404396 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.404609 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.404749 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.404932 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.405535 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.405769 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.405865 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.406074 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.406189 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.406489 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.406579 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.406801 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.406890 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.407120 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.407225 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.407430 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.407517 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.407757 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.407846 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.408077 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.408174 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.408398 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.408499 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.408704 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.408791 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.409023 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.409111 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.409331 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.409427 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.409657 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.409745 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.409988 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.410076 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.410312 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.410411 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.410622 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.410711 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.410924 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.411010 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.411226 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.411322 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.411527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.411634 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.411858 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.411946 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.412175 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.412263 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.412478 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.412564 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.412780 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.412868 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.413080 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.413176 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.413384 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.413471 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.413683 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.413769 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.413983 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.414075 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.414288 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.414386 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.414586 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.414682 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.414890 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.414980 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.415187 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.415282 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.415487 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.415584 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.415809 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.415911 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.416110 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.416199 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.416408 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.416505 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.416707 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.416796 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.417010 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.417096 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.417308 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.417470 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.417608 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.417697 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.417906 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.418002 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.418205 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.418302 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.418504 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.418615 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.418833 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.418956 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.419162 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.419320 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.419475 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.419596 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.419878 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.419967 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.420188 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.420278 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.420505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.420592 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.420863 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.420953 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.421183 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.421273 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.421501 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.421596 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.421812 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.421900 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.422119 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.422208 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.422447 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.422543 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.422755 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.422852 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.423064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.423159 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.423372 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.423460 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.423706 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.423815 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.424017 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.424106 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.424331 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.424422 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.424653 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.424750 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.424959 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.425055 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.425264 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.425353 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.425584 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.425674 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.425899 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.425989 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.426213 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.426302 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.426524 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.426611 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.426830 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.426917 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.427155 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.427249 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.427462 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.427550 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.427792 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.427882 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.428106 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.428205 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.428411 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.428499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.428723 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.428844 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.429036 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.429149 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.429345 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.429443 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.429669 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.429766 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.429981 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.430089 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.430287 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.430383 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.430608 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.430704 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.430930 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.431026 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.431254 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.431349 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.431566 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.431690 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.431929 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.432032 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.432252 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.432346 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.432562 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.432656 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.432867 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.432961 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.433115 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:17:48.433212 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:17:48.433399 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:17:48.495276 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO dbcounter [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] Registered counter for database nova_api Jun 16 00:17:48.495822 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO dbcounter [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Registered counter for database nova_api Jun 16 00:17:48.516111 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG oslo_db.sqlalchemy.engines [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:17:48.517776 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_db.sqlalchemy.engines [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:17:48.522801 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG dbcounter [-] [114660] Writer thread running {{(pid=114660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:17:48.524489 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writer thread running {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:17:48.578498 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.context [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f03a406-cd78-4a9a-b33f-da67f6bff5f7(cell1) {{(pid=114660) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 00:17:48.580892 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.context [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f03a406-cd78-4a9a-b33f-da67f6bff5f7(cell1) {{(pid=114659) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 00:17:48.582584 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG oslo_concurrency.lockutils [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:17:48.584194 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG oslo_concurrency.lockutils [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:17:48.584964 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:17:48.585077 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG oslo_concurrency.lockutils [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:17:48.586544 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:17:48.586932 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG oslo_concurrency.lockutils [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:17:48.587366 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:17:48.588900 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO dbcounter [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] Registered counter for database nova_cell0 Jun 16 00:17:48.589361 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:17:48.591322 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO dbcounter [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Registered counter for database nova_cell0 Jun 16 00:17:48.592743 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO dbcounter [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] Registered counter for database nova_cell1 Jun 16 00:17:48.595161 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO dbcounter [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Registered counter for database nova_cell1 Jun 16 00:17:48.600761 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG oslo_db.sqlalchemy.engines [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:17:48.602412 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG oslo_db.sqlalchemy.engines [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:17:48.604449 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_db.sqlalchemy.engines [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:17:48.606161 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_db.sqlalchemy.engines [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:17:48.608819 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG dbcounter [-] [114660] Writer thread running {{(pid=114660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:17:48.611894 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG dbcounter [-] [114660] Writer thread running {{(pid=114660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:17:48.612146 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writer thread running {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:17:48.614161 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writer thread running {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:17:48.757082 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO dbcounter [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Registered counter for database nova_cell0 Jun 16 00:17:48.758023 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO dbcounter [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] Registered counter for database nova_cell0 Jun 16 00:17:48.764167 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_db.sqlalchemy.engines [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:17:48.768104 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG oslo_db.sqlalchemy.engines [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:17:48.768948 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writer thread running {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:17:48.772464 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG dbcounter [-] [114660] Writer thread running {{(pid=114660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:17:49.101202 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: WARNING keystonemiddleware.auth_token [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:17:49.103747 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: WARNING keystonemiddleware.auth_token [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:17:49.108391 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: WARNING keystonemiddleware.auth_token [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:17:49.110947 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: WARNING keystonemiddleware.auth_token [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:17:49.448444 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: WARNING keystonemiddleware.auth_token [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:17:49.454412 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: WARNING keystonemiddleware.auth_token [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:17:49.456598 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: WARNING keystonemiddleware.auth_token [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:17:49.459757 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f34a4909c0 pid: 114659 (default app) Jun 16 00:17:49.461801 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:17:49.462989 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001728 Jun 16 00:17:49.463393 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Thu Jun 16 00:17:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:17:49.468551 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: WARNING keystonemiddleware.auth_token [None req-f6690bb4-ca25-4456-a9cc-8e25870799df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:17:49.473884 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f34a4909c0 pid: 114660 (default app) Jun 16 00:19:05.026246 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:05.027181 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 16 00:19:05.027811 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:05.039491 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG dbcounter [-] [114660] Writing DB stats nova_api:SELECT=3 {{(pid=114660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:05.040447 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG dbcounter [-] [114660] Writing DB stats nova_cell0:SELECT=3 {{(pid=114660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:05.041170 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG dbcounter [-] [114660] Writing DB stats nova_cell1:SELECT=3 {{(pid=114660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:05.042086 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG dbcounter [-] [114660] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:05.482377 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-8c14d532-103e-45b1-a928-645d240da7d7 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:05.512664 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-8c14d532-103e-45b1-a928-645d240da7d7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.478370 Jun 16 00:19:05.513423 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jun 16 00:19:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:07.670537 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:07.671593 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-2e0c6c3a-62f2-4ac6-9d5d-c21b205540a2 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jun 16 00:19:07.672056 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:07.736494 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-13fa7d19-1367-4cb8-922c-3aa34b0b398f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "ram": 256}} {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:07.755427 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:19:07.755427 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: warnings.warn(msg) Jun 16 00:19:07.784778 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-13fa7d19-1367-4cb8-922c-3aa34b0b398f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105574 Jun 16 00:19:07.787783 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 16 00:19:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:19:08.012936 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-9ce3f2c9-fd8d-4902-a37d-1863ad16b2f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:08.015286 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:19:08.015286 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: warnings.warn(msg) Jun 16 00:19:08.017954 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writing DB stats nova_api:SELECT=3 {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:08.018907 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writing DB stats nova_cell0:SELECT=3 {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:08.019591 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writing DB stats nova_cell1:SELECT=3 {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:08.020334 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:08.084996 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-9ce3f2c9-fd8d-4902-a37d-1863ad16b2f8 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291411 Jun 16 00:19:08.085588 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jun 16 00:19:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:10.274323 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-13fa7d19-1367-4cb8-922c-3aa34b0b398f admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:10.275477 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-13fa7d19-1367-4cb8-922c-3aa34b0b398f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Jun 16 00:19:10.276335 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:10.386629 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-1f8aae01-1692-4fa3-b38a-249862d35796 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "disk": 5, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:10.404520 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:19:10.404520 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: warnings.warn(msg) Jun 16 00:19:10.423767 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-1f8aae01-1692-4fa3-b38a-249862d35796 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141924 Jun 16 00:19:10.424321 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 16 00:19:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:19:10.436099 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-a35dbf71-98fa-442a-be41-dc8c569e2a98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:10.437620 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:19:10.437620 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: warnings.warn(msg) Jun 16 00:19:10.479473 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-a35dbf71-98fa-442a-be41-dc8c569e2a98 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046953 Jun 16 00:19:10.480159 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jun 16 00:19:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:12.655818 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-1f8aae01-1692-4fa3-b38a-249862d35796 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:12.656834 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-1f8aae01-1692-4fa3-b38a-249862d35796 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 16 00:19:12.657241 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:12.718857 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-29e70e21-b060-472e-9c69-5940c88e819e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:12.738932 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-29e70e21-b060-472e-9c69-5940c88e819e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075360 Jun 16 00:19:12.739696 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 16 00:19:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:19:12.751950 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-c737ea09-8b4c-4ed1-82cf-6867da377809 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:12.776087 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-c737ea09-8b4c-4ed1-82cf-6867da377809 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028050 Jun 16 00:19:12.776883 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jun 16 00:19:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:14.969313 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-29e70e21-b060-472e-9c69-5940c88e819e admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:14.970637 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-29e70e21-b060-472e-9c69-5940c88e819e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 Jun 16 00:19:14.971652 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:15.030177 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-c6a03cd4-0ad9-4329-bf7b-cf19cc1bc1fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "id": "d3", "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:15.048774 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-c6a03cd4-0ad9-4329-bf7b-cf19cc1bc1fb admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071087 Jun 16 00:19:15.049395 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 16 00:19:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:19:15.062387 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-f7bb5155-4ed9-4ed6-9f75-bcc36e7f0fc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:15.084673 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-f7bb5155-4ed9-4ed6-9f75-bcc36e7f0fc4 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026453 Jun 16 00:19:15.085262 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jun 16 00:19:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:17.271148 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-c6a03cd4-0ad9-4329-bf7b-cf19cc1bc1fb admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:17.272180 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-c6a03cd4-0ad9-4329-bf7b-cf19cc1bc1fb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 16 00:19:17.272572 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:17.333659 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-844d6cb3-0af0-442c-aee1-30db4b530fb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "vcpus": 4, "id": "d4", "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:17.353437 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-844d6cb3-0af0-442c-aee1-30db4b530fb1 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075186 Jun 16 00:19:17.354249 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 16 00:19:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:19:17.366401 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-2e7d3431-5dfc-46bb-b67f-6af758419974 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:17.390258 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-2e7d3431-5dfc-46bb-b67f-6af758419974 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027556 Jun 16 00:19:17.390974 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jun 16 00:19:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:19.539211 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-844d6cb3-0af0-442c-aee1-30db4b530fb1 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:19.540308 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-844d6cb3-0af0-442c-aee1-30db4b530fb1 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 16 00:19:19.540866 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:19.607338 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-2d582f19-6773-4e73-88b7-676cda956d68 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:19.631537 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-2d582f19-6773-4e73-88b7-676cda956d68 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084373 Jun 16 00:19:19.632390 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jun 16 00:19:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:19:21.943142 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-844d6cb3-0af0-442c-aee1-30db4b530fb1 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:21.944165 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-844d6cb3-0af0-442c-aee1-30db4b530fb1 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jun 16 00:19:21.944573 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:22.012355 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-fddd625e-0435-47bc-bb9f-a6366ee86776 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "id": "1", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:22.031152 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-fddd625e-0435-47bc-bb9f-a6366ee86776 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080468 Jun 16 00:19:22.031785 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 16 00:19:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:19:22.044239 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-43475a85-376e-4bfd-bc76-7e72e21694cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:22.067138 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-43475a85-376e-4bfd-bc76-7e72e21694cc admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026492 Jun 16 00:19:22.067585 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jun 16 00:19:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:24.214464 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-fddd625e-0435-47bc-bb9f-a6366ee86776 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:24.215469 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-fddd625e-0435-47bc-bb9f-a6366ee86776 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 16 00:19:24.215903 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:24.275413 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-0d7e0dc5-d7bc-41b6-8644-a61d08b75d1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:24.292582 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-0d7e0dc5-d7bc-41b6-8644-a61d08b75d1c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071032 Jun 16 00:19:24.293106 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 16 00:19:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:19:24.307194 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-4ed57450-e646-4921-b0bb-3d9c41fa7ef9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:24.337562 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-4ed57450-e646-4921-b0bb-3d9c41fa7ef9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035303 Jun 16 00:19:24.338326 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jun 16 00:19:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:26.512831 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-0d7e0dc5-d7bc-41b6-8644-a61d08b75d1c admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:26.513886 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-0d7e0dc5-d7bc-41b6-8644-a61d08b75d1c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 16 00:19:26.514292 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:26.586758 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-ab0607c4-8d24-4264-be1d-785985093918 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "id": "3"}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:26.608298 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-ab0607c4-8d24-4264-be1d-785985093918 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.084955 Jun 16 00:19:26.609299 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 16 00:19:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:19:26.626117 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-0985fbb4-8017-419a-9851-eee0b53963af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:26.657539 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-0985fbb4-8017-419a-9851-eee0b53963af admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036976 Jun 16 00:19:26.658204 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jun 16 00:19:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:28.868484 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-ab0607c4-8d24-4264-be1d-785985093918 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:28.869492 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-ab0607c4-8d24-4264-be1d-785985093918 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 16 00:19:28.869890 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:28.932239 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-6f7ea33f-7a6e-440f-8baf-4eeb1308ef53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0}} {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:28.950467 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-6f7ea33f-7a6e-440f-8baf-4eeb1308ef53 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074746 Jun 16 00:19:28.951017 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 16 00:19:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:19:28.963121 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-ed635d2d-c94c-4f93-bcc3-7400aa313ac9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:28.987377 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-ed635d2d-c94c-4f93-bcc3-7400aa313ac9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027812 Jun 16 00:19:28.987993 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jun 16 00:19:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:31.184391 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-6f7ea33f-7a6e-440f-8baf-4eeb1308ef53 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:31.185394 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-6f7ea33f-7a6e-440f-8baf-4eeb1308ef53 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 16 00:19:31.186107 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:31.261477 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-67c42b66-8ade-47c4-9d35-3de8b3b8ad45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5"}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:31.282933 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-67c42b66-8ade-47c4-9d35-3de8b3b8ad45 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089384 Jun 16 00:19:31.283942 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jun 16 00:19:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:19:31.296489 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-a5977c9b-1853-4354-947e-ae1ff724130d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:19:31.325661 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-a5977c9b-1853-4354-947e-ae1ff724130d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032362 Jun 16 00:19:31.328043 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jun 16 00:19:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:19:55.368908 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-67c42b66-8ade-47c4-9d35-3de8b3b8ad45 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:55.369905 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-67c42b66-8ade-47c4-9d35-3de8b3b8ad45 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 16 00:19:55.370310 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:19:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:55.380728 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG dbcounter [-] [114660] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=114660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:55.430171 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-6459958c-8ec8-44d4-85ff-89a189dea527 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:55.447202 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-6459958c-8ec8-44d4-85ff-89a189dea527 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071052 Jun 16 00:19:55.447756 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jun 16 00:19:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:19:56.414962 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-67c42b66-8ade-47c4-9d35-3de8b3b8ad45 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:56.415983 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-67c42b66-8ade-47c4-9d35-3de8b3b8ad45 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 16 00:19:56.416384 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 16 00:19:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:56.605047 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-9ccd2851-bc2f-42a4-a731-54046788abc2 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:56.611405 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.wsgi [None req-9ccd2851-bc2f-42a4-a731-54046788abc2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-9ccd2851-bc2f-42a4-a731-54046788abc2 admin admin] Request method failure captured: Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Accept: application/json Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Accept-Encoding: gzip, deflate Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Connection: keep-alive Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Content-Length: 0 Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Host: 10.222.0.44 Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Openstack-Api-Version: compute 2.90 Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Openstack-System-Scope: None Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: User-Agent: python-novaclient Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Auth-Token: gAAAAABiqncseO5tTLAOhkl3zu5hGsf3_zxWxuQfiHjzaxBQWBumUiRJLhDcMAevWdTEhfuxAwgbdKVdnoQHtSVqz4kIk1bb9WaVm8ZVxu7yYjjjLxzud7WchdZIXS_iyUmiW2fEOMYsMA8zA1kD9ON7hSQTI1-knEJY1UEc69o1jVJKEnQcwNg Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Domain-Id: None Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Domain-Name: None Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Identity-Status: Confirmed Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Is-Admin-Project: True Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Project-Domain-Id: default Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Project-Domain-Name: Default Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Project-Id: ec07de477e084ea786d462c55e9192b8 Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Project-Name: admin Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Role: reader,member,admin Jun 16 00:19:56.614825 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Roles: reader,member,admin Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ec07de477e084ea786d462c55e9192b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Tenant: admin Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Tenant-Id: ec07de477e084ea786d462c55e9192b8 Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Tenant-Name: admin Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User: admin Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User-Domain-Id: default Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User-Domain-Name: Default Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User-Id: 5827dca4e6e6440096187e88acac47af Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User-Name: admin Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: method: > Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: exception: Flavor 42 could not be found. Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: action_args: {'id': '42'} Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:19:56.616382 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:19:56.617312 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:56.618581 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-9ccd2851-bc2f-42a4-a731-54046788abc2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:19:56.619637 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-9ccd2851-bc2f-42a4-a731-54046788abc2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062402 Jun 16 00:19:56.619637 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jun 16 00:19:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:56.625825 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-9f110b52-25bf-4532-9790-fe068a2bb2e5 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:56.629201 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:56.647859 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-9f110b52-25bf-4532-9790-fe068a2bb2e5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025635 Jun 16 00:19:56.648376 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jun 16 00:19:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:19:56.657682 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-f0690093-40a3-448b-bd55-ac27706508df admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:56.678907 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-f0690093-40a3-448b-bd55-ac27706508df admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024752 Jun 16 00:19:56.679421 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jun 16 00:19:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:19:56.689574 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-3d4865b2-e572-4662-af40-6efd6760f690 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:56.695743 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.wsgi [None req-3d4865b2-e572-4662-af40-6efd6760f690 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-3d4865b2-e572-4662-af40-6efd6760f690 admin admin] Request method failure captured: Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Accept: application/json Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Accept-Encoding: gzip, deflate Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Connection: keep-alive Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Content-Length: 0 Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Host: 10.222.0.44 Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Openstack-Api-Version: compute 2.90 Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Openstack-System-Scope: None Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: User-Agent: python-novaclient Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Auth-Token: gAAAAABiqncseO5tTLAOhkl3zu5hGsf3_zxWxuQfiHjzaxBQWBumUiRJLhDcMAevWdTEhfuxAwgbdKVdnoQHtSVqz4kIk1bb9WaVm8ZVxu7yYjjjLxzud7WchdZIXS_iyUmiW2fEOMYsMA8zA1kD9ON7hSQTI1-knEJY1UEc69o1jVJKEnQcwNg Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Domain-Id: None Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Domain-Name: None Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Identity-Status: Confirmed Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Is-Admin-Project: True Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Project-Domain-Id: default Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Project-Domain-Name: Default Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Project-Id: ec07de477e084ea786d462c55e9192b8 Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Project-Name: admin Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Role: reader,member,admin Jun 16 00:19:56.698952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Roles: reader,member,admin Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ec07de477e084ea786d462c55e9192b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Tenant: admin Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Tenant-Id: ec07de477e084ea786d462c55e9192b8 Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Tenant-Name: admin Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User: admin Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User-Domain-Id: default Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User-Domain-Name: Default Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User-Id: 5827dca4e6e6440096187e88acac47af Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User-Name: admin Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: method: > Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: exception: Flavor 42 could not be found. Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: action_args: {'id': '42'} Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:19:56.700608 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:19:56.701747 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:56.703052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-3d4865b2-e572-4662-af40-6efd6760f690 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:19:56.705034 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-3d4865b2-e572-4662-af40-6efd6760f690 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015447 Jun 16 00:19:56.705034 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jun 16 00:19:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 00:19:57.560001 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-f0690093-40a3-448b-bd55-ac27706508df admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:57.561009 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-f0690093-40a3-448b-bd55-ac27706508df admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 16 00:19:57.561406 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 16 00:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:57.753292 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-07e83859-f77f-42b1-b28d-38cbdcf0b4da admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:57.759045 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.wsgi [None req-07e83859-f77f-42b1-b28d-38cbdcf0b4da admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-07e83859-f77f-42b1-b28d-38cbdcf0b4da admin admin] Request method failure captured: Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Accept: application/json Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Accept-Encoding: gzip, deflate Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Connection: keep-alive Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Content-Length: 0 Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Host: 10.222.0.44 Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Openstack-Api-Version: compute 2.90 Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Openstack-System-Scope: None Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: User-Agent: python-novaclient Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Auth-Token: gAAAAABiqnct-XRT8o9VnXsg8Hv8yY3pROehnKhovYjNzVZnPeLe2-w4cROTB7vq9uB0LJAowMla_klv8VMbWT-lu8s4CTXZ3sk53GQu3-Oi3v0OTFJQHC2Bq6X45iJMZs4aRav8Z-sQ7WsOjkAk-iuVMml2KsnX-eDV4KG-lPBhZU_wOXH0S28 Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Domain-Id: None Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Domain-Name: None Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Identity-Status: Confirmed Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Is-Admin-Project: True Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Project-Domain-Id: default Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Project-Domain-Name: Default Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Project-Id: ec07de477e084ea786d462c55e9192b8 Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Project-Name: admin Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Role: reader,member,admin Jun 16 00:19:57.760578 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Roles: reader,member,admin Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ec07de477e084ea786d462c55e9192b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Tenant: admin Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Tenant-Id: ec07de477e084ea786d462c55e9192b8 Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Tenant-Name: admin Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User: admin Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User-Domain-Id: default Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User-Domain-Name: Default Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User-Id: 5827dca4e6e6440096187e88acac47af Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User-Name: admin Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: method: > Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: exception: Flavor 84 could not be found. Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: action_args: {'id': '84'} Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:19:57.762119 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:19:57.763116 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:57.764317 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-07e83859-f77f-42b1-b28d-38cbdcf0b4da admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:19:57.765337 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-07e83859-f77f-42b1-b28d-38cbdcf0b4da admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060038 Jun 16 00:19:57.765337 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jun 16 00:19:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:57.772130 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-e155ba7b-4901-4bf3-a9e4-acbd56d4ad64 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:57.787239 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-e155ba7b-4901-4bf3-a9e4-acbd56d4ad64 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018725 Jun 16 00:19:57.787810 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jun 16 00:19:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:19:57.797171 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-c533a35d-29ef-45d9-a3ee-6e9ad8c2e2bd admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:57.810713 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-c533a35d-29ef-45d9-a3ee-6e9ad8c2e2bd admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017095 Jun 16 00:19:57.811238 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jun 16 00:19:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:19:57.820906 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-9113576e-3587-4e9b-8dc5-c92fc3d666a9 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:57.826189 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.wsgi [None req-9113576e-3587-4e9b-8dc5-c92fc3d666a9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-9113576e-3587-4e9b-8dc5-c92fc3d666a9 admin admin] Request method failure captured: Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Accept: application/json Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Accept-Encoding: gzip, deflate Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Connection: keep-alive Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Content-Length: 0 Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Host: 10.222.0.44 Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Openstack-Api-Version: compute 2.90 Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Openstack-System-Scope: None Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: User-Agent: python-novaclient Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Auth-Token: gAAAAABiqnct-XRT8o9VnXsg8Hv8yY3pROehnKhovYjNzVZnPeLe2-w4cROTB7vq9uB0LJAowMla_klv8VMbWT-lu8s4CTXZ3sk53GQu3-Oi3v0OTFJQHC2Bq6X45iJMZs4aRav8Z-sQ7WsOjkAk-iuVMml2KsnX-eDV4KG-lPBhZU_wOXH0S28 Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Domain-Id: None Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Domain-Name: None Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Identity-Status: Confirmed Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Is-Admin-Project: True Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Project-Domain-Id: default Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Project-Domain-Name: Default Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Project-Id: ec07de477e084ea786d462c55e9192b8 Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Project-Name: admin Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Role: reader,member,admin Jun 16 00:19:57.827699 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Roles: reader,member,admin Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ec07de477e084ea786d462c55e9192b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Tenant: admin Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Tenant-Id: ec07de477e084ea786d462c55e9192b8 Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Tenant-Name: admin Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User: admin Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User-Domain-Id: default Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User-Domain-Name: Default Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User-Id: 5827dca4e6e6440096187e88acac47af Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User-Name: admin Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: method: > Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: exception: Flavor 84 could not be found. Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: action_args: {'id': '84'} Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:19:57.829252 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:19:57.830779 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:57.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-9113576e-3587-4e9b-8dc5-c92fc3d666a9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:19:57.833465 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-9113576e-3587-4e9b-8dc5-c92fc3d666a9 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011701 Jun 16 00:19:57.833465 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jun 16 00:19:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 00:19:58.686855 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-c533a35d-29ef-45d9-a3ee-6e9ad8c2e2bd admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:58.687890 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-c533a35d-29ef-45d9-a3ee-6e9ad8c2e2bd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 16 00:19:58.688282 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 16 00:19:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:19:58.878298 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-614d79de-b1dd-4b47-bc26-7c2649341fac admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:58.884014 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.wsgi [None req-614d79de-b1dd-4b47-bc26-7c2649341fac admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-614d79de-b1dd-4b47-bc26-7c2649341fac admin admin] Request method failure captured: Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Accept: application/json Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Accept-Encoding: gzip, deflate Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Connection: keep-alive Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Content-Length: 0 Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Host: 10.222.0.44 Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Openstack-Api-Version: compute 2.90 Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Openstack-System-Scope: None Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: User-Agent: python-novaclient Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Auth-Token: gAAAAABiqncuyShfRsSepjYb4uONP8QexMU_niLmjXW-KB31fURT8SjM4n_UFupxJsz_PdJVvVTK5J2lqgz3kJjqOX8UzrgG5OecSUUY8h-6hQ5hgMh0QGvg9MEnj5zNs8zBNONJ-70_toQ1MHnZLPspL7HrO1QJyRtsRMr03tZqi5GkE5aTCH0 Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Domain-Id: None Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Domain-Name: None Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Identity-Status: Confirmed Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Is-Admin-Project: True Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Project-Domain-Id: default Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Project-Domain-Name: Default Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Project-Id: ec07de477e084ea786d462c55e9192b8 Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Project-Name: admin Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Role: reader,member,admin Jun 16 00:19:58.885505 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Roles: reader,member,admin Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ec07de477e084ea786d462c55e9192b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Tenant: admin Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Tenant-Id: ec07de477e084ea786d462c55e9192b8 Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-Tenant-Name: admin Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User: admin Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User-Domain-Id: default Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User-Domain-Name: Default Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User-Id: 5827dca4e6e6440096187e88acac47af Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: X-User-Name: admin Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: method: > Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: exception: Flavor 451 could not be found. Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: action_args: {'id': '451'} Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:19:58.887064 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:19:58.888060 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: ERROR nova.api.openstack.wsgi Jun 16 00:19:58.889527 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-614d79de-b1dd-4b47-bc26-7c2649341fac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:19:58.890772 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-614d79de-b1dd-4b47-bc26-7c2649341fac admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060463 Jun 16 00:19:58.890772 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jun 16 00:19:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:58.896381 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-f7e1fe7b-f676-412f-b6a8-73b6b394f296 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:58.911042 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-f7e1fe7b-f676-412f-b6a8-73b6b394f296 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018260 Jun 16 00:19:58.911563 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jun 16 00:19:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:19:58.920793 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:58.934898 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017685 Jun 16 00:19:58.935407 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jun 16 00:19:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:19:58.945096 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-f2c9d113-72f4-4788-a109-dba90cacd185 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:58.950415 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.wsgi [None req-f2c9d113-72f4-4788-a109-dba90cacd185 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-f2c9d113-72f4-4788-a109-dba90cacd185 admin admin] Request method failure captured: Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Accept: application/json Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Accept-Encoding: gzip, deflate Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Connection: keep-alive Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Content-Length: 0 Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Host: 10.222.0.44 Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Openstack-Api-Version: compute 2.90 Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Openstack-System-Scope: None Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: User-Agent: python-novaclient Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Auth-Token: gAAAAABiqncuyShfRsSepjYb4uONP8QexMU_niLmjXW-KB31fURT8SjM4n_UFupxJsz_PdJVvVTK5J2lqgz3kJjqOX8UzrgG5OecSUUY8h-6hQ5hgMh0QGvg9MEnj5zNs8zBNONJ-70_toQ1MHnZLPspL7HrO1QJyRtsRMr03tZqi5GkE5aTCH0 Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Domain-Id: None Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Domain-Name: None Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Identity-Status: Confirmed Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Is-Admin-Project: True Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Project-Domain-Id: default Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Project-Domain-Name: Default Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Project-Id: ec07de477e084ea786d462c55e9192b8 Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Project-Name: admin Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Role: reader,member,admin Jun 16 00:19:58.951957 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Roles: reader,member,admin Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ec07de477e084ea786d462c55e9192b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ec07de477e084ea786d462c55e9192b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Tenant: admin Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Tenant-Id: ec07de477e084ea786d462c55e9192b8 Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-Tenant-Name: admin Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User: admin Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User-Domain-Id: default Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User-Domain-Name: Default Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User-Id: 5827dca4e6e6440096187e88acac47af Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: X-User-Name: admin Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: method: > Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: exception: Flavor 451 could not be found. Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: action_args: {'id': '451'} Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:19:58.953499 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:19:58.954446 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: ERROR nova.api.openstack.wsgi Jun 16 00:19:58.955761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-f2c9d113-72f4-4788-a109-dba90cacd185 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:19:58.957016 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-f2c9d113-72f4-4788-a109-dba90cacd185 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011778 Jun 16 00:19:58.957016 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jun 16 00:19:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:59.812608 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:19:59.813650 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 16 00:19:59.814046 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 16 00:19:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:00.004684 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-fdedb4b1-e831-46fa-93e1-9255a32bbf7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:00.022274 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-fdedb4b1-e831-46fa-93e1-9255a32bbf7c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068929 Jun 16 00:20:00.022739 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jun 16 00:19:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:00.884076 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:00.885080 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 16 00:20:00.885471 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 16 00:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:01.075963 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-3ff153de-50cf-4fb0-9ffd-0d587af4ea3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:01.092543 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-3ff153de-50cf-4fb0-9ffd-0d587af4ea3c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067645 Jun 16 00:20:01.093078 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jun 16 00:20:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:01.954281 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:01.955325 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 16 00:20:01.956269 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 16 00:20:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:02.145187 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-48a2a4d8-fd2c-4d23-8a77-75a2beab33f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:02.162538 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-48a2a4d8-fd2c-4d23-8a77-75a2beab33f1 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069036 Jun 16 00:20:02.163078 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jun 16 00:20:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:03.023553 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:03.024598 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 16 00:20:03.025007 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 16 00:20:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:03.214032 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-8e50db6b-2344-48ec-8c92-6b029cb39f5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:20:03.232765 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-8e50db6b-2344-48ec-8c92-6b029cb39f5d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069811 Jun 16 00:20:03.233295 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jun 16 00:20:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:20:04.094659 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:04.095700 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jun 16 00:20:04.096097 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 16 00:20:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:04.284210 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-9d1d51ee-95a0-455b-985c-e9b41d29ef3b admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:04.303530 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-9d1d51ee-95a0-455b-985c-e9b41d29ef3b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070959 Jun 16 00:20:04.304094 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Thu Jun 16 00:20:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:20:51.913471 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:51.914465 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-da0de6ab-be40-4903-882d-78243058f859 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 16 00:20:51.914862 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jun 16 00:20:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:20:51.924944 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:51.972189 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-d6d91156-6a2f-4812-8fe2-66797e4b0105 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:51.990797 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-d6d91156-6a2f-4812-8fe2-66797e4b0105 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070327 Jun 16 00:20:51.991321 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jun 16 00:20:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:20:52.014222 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-c77e590b-25f0-4e10-9828-0d28514333bc admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:52.017661 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG dbcounter [-] [114660] Writing DB stats nova_api:SELECT=14 {{(pid=114660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:52.023081 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-c77e590b-25f0-4e10-9828-0d28514333bc admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012953 Jun 16 00:20:52.023592 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Thu Jun 16 00:20:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:52.035579 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-e0fbee0f-57ab-4eb5-af38-3ba5df6f5d94 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:52.043023 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-e0fbee0f-57ab-4eb5-af38-3ba5df6f5d94 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010939 Jun 16 00:20:52.043526 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Thu Jun 16 00:20:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:52.054936 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-9cb05f5b-389b-411b-ab8b-a72ca7bd8fac admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:52.062861 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-9cb05f5b-389b-411b-ab8b-a72ca7bd8fac admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011747 Jun 16 00:20:52.063373 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Thu Jun 16 00:20:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:20:52.074195 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-e00d96e6-0ac8-4753-aa3e-ec6b7c986a28 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:20:52.082193 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-e00d96e6-0ac8-4753-aa3e-ec6b7c986a28 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011379 Jun 16 00:20:52.082700 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Thu Jun 16 00:20:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:24:05.123212 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-9cb05f5b-389b-411b-ab8b-a72ca7bd8fac admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:24:05.124333 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-9cb05f5b-389b-411b-ab8b-a72ca7bd8fac admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jun 16 00:24:05.124721 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 16 00:24:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:24:05.279606 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writing DB stats nova_api:SELECT=6 {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:05.392909 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-ddef69fa-1da9-4d59-8f43-7a3b52f1fcea admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:24:05.394080 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:24:05.394080 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: warnings.warn(msg) Jun 16 00:24:05.395281 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-ddef69fa-1da9-4d59-8f43-7a3b52f1fcea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:24:05.395761 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-ddef69fa-1da9-4d59-8f43-7a3b52f1fcea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:24:05.396547 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-ddef69fa-1da9-4d59-8f43-7a3b52f1fcea admin admin] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:24:05.396975 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-ddef69fa-1da9-4d59-8f43-7a3b52f1fcea admin admin] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:24:05.431117 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-ddef69fa-1da9-4d59-8f43-7a3b52f1fcea admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152903 Jun 16 00:24:05.431697 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jun 16 00:24:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:24:06.293925 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-9cb05f5b-389b-411b-ab8b-a72ca7bd8fac admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:24:06.294929 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-9cb05f5b-389b-411b-ab8b-a72ca7bd8fac admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 16 00:24:06.295318 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 16 00:24:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:24:06.485052 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-b73989bc-d125-47e8-891d-bf2f7bfe6fe7 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:24:06.486220 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:24:06.486220 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: warnings.warn(msg) Jun 16 00:24:06.487415 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-b73989bc-d125-47e8-891d-bf2f7bfe6fe7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:24:06.487879 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-b73989bc-d125-47e8-891d-bf2f7bfe6fe7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:24:06.488651 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-b73989bc-d125-47e8-891d-bf2f7bfe6fe7 admin admin] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:24:06.489072 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-b73989bc-d125-47e8-891d-bf2f7bfe6fe7 admin admin] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:24:06.508837 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-b73989bc-d125-47e8-891d-bf2f7bfe6fe7 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074566 Jun 16 00:24:06.509315 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jun 16 00:24:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:24:17.841197 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-9cb05f5b-389b-411b-ab8b-a72ca7bd8fac admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:24:17.842210 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-9cb05f5b-389b-411b-ab8b-a72ca7bd8fac admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 16 00:24:17.842607 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 16 00:24:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:24:17.988613 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writing DB stats nova_cell0:SELECT=4 {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:17.989340 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writing DB stats nova_cell1:SELECT=4 {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:17.989952 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG dbcounter [-] [114659] Writing DB stats nova_api:SELECT=8 {{(pid=114659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:18.040248 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-2dd5b9b5-c836-4208-9c60-d8542f6ba07d admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:24:18.041418 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:24:18.041418 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: warnings.warn(msg) Jun 16 00:24:18.042600 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-2dd5b9b5-c836-4208-9c60-d8542f6ba07d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:24:18.043088 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-2dd5b9b5-c836-4208-9c60-d8542f6ba07d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:24:18.043846 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-2dd5b9b5-c836-4208-9c60-d8542f6ba07d admin admin] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:24:18.044274 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-2dd5b9b5-c836-4208-9c60-d8542f6ba07d admin admin] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:24:18.077706 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-2dd5b9b5-c836-4208-9c60-d8542f6ba07d admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.093569 Jun 16 00:24:18.078292 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jun 16 00:24:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:24:19.017665 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: DEBUG nova.api.openstack.wsgi [None req-9cb05f5b-389b-411b-ab8b-a72ca7bd8fac admin admin] Calling method '>' {{(pid=114660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:24:19.018678 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: INFO nova.api.openstack.requestlog [None req-9cb05f5b-389b-411b-ab8b-a72ca7bd8fac admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 16 00:24:19.019085 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: [pid: 114660|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jun 16 00:24:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:24:19.210554 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG nova.api.openstack.wsgi [None req-ee277288-1b59-47ef-88d5-dc62259e0ef4 admin admin] Calling method '>' {{(pid=114659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:24:19.211749 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:24:19.211749 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: warnings.warn(msg) Jun 16 00:24:19.212929 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-ee277288-1b59-47ef-88d5-dc62259e0ef4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:24:19.213364 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-ee277288-1b59-47ef-88d5-dc62259e0ef4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:24:19.214140 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-ee277288-1b59-47ef-88d5-dc62259e0ef4 admin admin] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:24:19.214564 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: DEBUG oslo_concurrency.lockutils [None req-ee277288-1b59-47ef-88d5-dc62259e0ef4 admin admin] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:24:19.236270 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: INFO nova.api.openstack.requestlog [None req-ee277288-1b59-47ef-88d5-dc62259e0ef4 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076472 Jun 16 00:24:19.236799 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: [pid: 114659|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jun 16 00:24:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:25:17.451111 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: Thu Jun 16 00:25:17 2022 - graceful shutdown triggered... Jun 16 00:25:17.451229 dv-cinder-843277-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 00:25:17.452239 dv-cinder-843277-4-iscsi devstack@n-api.service[114659]: Gracefully killing worker 1 (pid: 114659)... Jun 16 00:25:17.452994 dv-cinder-843277-4-iscsi devstack@n-api.service[114660]: Gracefully killing worker 2 (pid: 114660)... Jun 16 00:25:18.453303 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: worker 1 buried after 1 seconds Jun 16 00:25:18.453827 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: worker 2 buried after 1 seconds Jun 16 00:25:18.453827 dv-cinder-843277-4-iscsi devstack@n-api.service[114658]: goodbye to uWSGI. Jun 16 00:25:18.454840 dv-cinder-843277-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 00:25:18.455391 dv-cinder-843277-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 00:25:18.458097 dv-cinder-843277-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 00:25:18.469364 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 00:25:18.471391 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 00:25:18 2022] *** Jun 16 00:25:18.471391 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 00:25:18.471391 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 00:25:18.471391 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: nodename: dv-cinder-843277-4-iscsi Jun 16 00:25:18.471391 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: machine: x86_64 Jun 16 00:25:18.471391 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: clock source: unix Jun 16 00:25:18.471391 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: pcre jit disabled Jun 16 00:25:18.471391 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: detected number of CPU cores: 4 Jun 16 00:25:18.471391 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: current working directory: / Jun 16 00:25:18.471391 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: detected binary path: /usr/bin/uwsgi-core Jun 16 00:25:18.472080 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: your processes number limit is 47680 Jun 16 00:25:18.472080 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: your memory page size is 4096 bytes Jun 16 00:25:18.472080 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: detected max file descriptor number: 2048 Jun 16 00:25:18.472080 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: lock engine: pthread robust mutexes Jun 16 00:25:18.472080 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: thunder lock: enabled Jun 16 00:25:18.472080 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 00:25:18.472080 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 00:25:18.516917 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: Python main interpreter initialized at 0x55efccbae9c0 Jun 16 00:25:18.516917 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: python threads support enabled Jun 16 00:25:18.516917 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: your server socket listen backlog is limited to 100 connections Jun 16 00:25:18.516917 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: your mercy for graceful operations on workers is 90 seconds Jun 16 00:25:18.517372 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 00:25:18.517372 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: *** Operational MODE: preforking *** Jun 16 00:25:18.517629 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: *** uWSGI is running in multiple interpreter mode *** Jun 16 00:25:18.517629 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: spawned uWSGI master process (pid: 129448) Jun 16 00:25:18.517834 dv-cinder-843277-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 00:25:18.518480 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: spawned uWSGI worker 1 (pid: 129465, cores: 1) Jun 16 00:25:18.518809 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: spawned uWSGI worker 2 (pid: 129466, cores: 1) Jun 16 00:25:18.522737 dv-cinder-843277-4-iscsi devstack@n-api.service[129448]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 00:25:19.171173 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 00:25:19.173433 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 00:25:20.398496 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:25:20.398496 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: from cryptography.utils import int_from_bytes Jun 16 00:25:20.399153 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:25:20.399153 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: from cryptography.utils import int_from_bytes Jun 16 00:25:20.408749 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:25:20.408749 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: from cryptography.utils import int_from_bytes Jun 16 00:25:20.409233 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:25:20.409233 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: from cryptography.utils import int_from_bytes Jun 16 00:25:22.787069 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:25:22.787854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:25:22.787854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:25:22.788224 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:25:22.788478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:25:22.788862 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.789184 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.789504 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.789820 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.790146 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.790456 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.790781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.791102 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.791426 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.791710 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.792026 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.792348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-4-iscsi {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.792666 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.792971 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.793280 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.793605 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.793904 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.797501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.797501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.797501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.797501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.797501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.797501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.797996 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.797996 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.797996 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.797996 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.797996 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.797996 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.798430 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.798725 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-4-iscsi {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.798895 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.799185 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.799501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.799942 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.800250 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.800887 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.800887 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.801183 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.801491 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.801814 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.802127 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.802473 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.802790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.803091 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.803397 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.803729 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.804063 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.804354 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.804654 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.804905 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.805213 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.805533 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.805850 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.806168 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.806420 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.806668 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.806983 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.807302 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.807633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.808001 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.808245 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.808550 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.808855 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.809370 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.809478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.809757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.810073 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.810386 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.810713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.811019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.811334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.811768 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.812025 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.812333 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.812674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.812993 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.813303 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.819685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.819685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.819685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.819685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.819685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.819685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.819685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.819685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.820836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.820836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.820836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.820836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.821230 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:25:22.821650 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.821742 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:25:22.821840 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.821840 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.822012 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:25:22.822113 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.822209 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:25:22.822303 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.822403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:25:22.822492 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.822579 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.822680 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.822769 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.822865 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.822953 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.823037 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.823157 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.823253 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.823347 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.823435 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.823521 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.823645 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.823831 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.823992 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.824161 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.824318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.824472 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.824618 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.824781 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.824926 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.825081 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.825232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.825387 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-4-iscsi {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.825550 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.825695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.825848 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.826005 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.826352 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.826515 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.826661 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.826661 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.826935 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.826935 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.827230 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.827230 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.827525 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.827708 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.827872 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.828046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.828263 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.828455 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.828619 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.828765 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.828923 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.829077 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.829221 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.829372 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.829524 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.829677 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.829837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.829991 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.830146 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.830298 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.830450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.830605 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.830763 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.830915 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.831068 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.831228 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.831228 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.831528 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.831750 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.831910 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-4-iscsi {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.832057 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.832218 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.832376 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.832528 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.832672 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.832816 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.832969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.833114 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.833268 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.833420 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.834134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.834290 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.834446 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.834602 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.834756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.834909 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.835063 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.835210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.835355 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.835499 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.835734 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.835899 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.836045 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.836190 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.836524 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.836687 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.836854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.837010 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.837162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.837326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.837473 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.837627 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.837786 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.837939 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.838086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.838230 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.838386 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.838541 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.838707 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.838859 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.839004 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.839147 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.839301 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.839457 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.839636 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.839801 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.839955 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.840107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.840265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.840410 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.840410 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.840712 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.840856 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.841017 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.841162 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.841306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.841457 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.841612 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.841758 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.841915 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.842066 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.842210 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.842364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.842509 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.842659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.842818 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.842970 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.843122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.843267 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.843417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.843569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.843793 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.843949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.844100 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.844253 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.844416 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.844579 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.844725 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.844869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.845012 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.845155 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.845300 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.845532 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.845691 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.845843 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.845998 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.846143 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.846286 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.846477 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.846799 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.846953 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.847114 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.847267 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.847416 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.847570 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.847772 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.847921 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.848075 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.848236 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.848391 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.848549 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.848705 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.848861 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.849012 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.849156 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.849314 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.849468 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.849621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.849774 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.849920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.850070 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.850228 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.850381 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.850536 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.850688 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.850878 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.851031 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.851185 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.851337 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.851481 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.851666 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.851829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.851977 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.852133 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.852278 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.852431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.852586 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.852729 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.852888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.853048 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.853202 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.853356 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.853507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.853659 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.853814 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.853958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.854103 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.854247 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.854391 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.854552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.854706 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.854857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.855010 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.855155 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.855308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.855466 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.855646 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.855811 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.855957 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.856112 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.856258 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.856401 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.856560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.856893 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.857056 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.857211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.857377 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.857522 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.857667 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.857818 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.857962 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.858115 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.858272 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.858424 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.858576 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.858738 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.858890 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.859045 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.859200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.859354 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.859500 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.859672 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.859825 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.859984 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.860137 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.860281 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.860426 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.860580 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.860732 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.860886 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.861039 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.861190 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.861334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.861479 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.861622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.861779 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.861935 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.862080 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.862231 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.862383 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.862539 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.862712 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.862863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.863007 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.863152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.863302 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.863459 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.863604 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.863792 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.863946 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.864090 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.864244 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.864403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.864563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.864706 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.864849 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.864992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.865142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.865299 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.865454 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.865612 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:25:22.865766 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.865910 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.866055 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.866213 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.866365 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.866520 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.866665 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.866829 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.867142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.867304 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.867452 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.867596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.867794 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.867794 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.868084 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.868084 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.868359 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.868512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.868665 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.868810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.868967 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.869119 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.869271 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.869415 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.869567 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.869726 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.869879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.870031 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.870176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.870319 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.870473 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.870473 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.870938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.871094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.871246 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.871391 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.871535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.871792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.871994 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.872149 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.872303 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.872448 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.872600 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.872765 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.872911 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.873056 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.873215 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.873361 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.873520 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.873673 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.873817 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.873971 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.874125 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.874271 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.874562 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.874749 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.874907 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.875053 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.875197 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.875341 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.875496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.875672 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.875835 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.876121 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.876292 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.876447 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.876603 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.876755 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.876917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.877089 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.877416 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.877572 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.877727 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.877881 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.878025 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.878170 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.878324 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.878478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.878624 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.878780 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.878933 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.879088 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.879242 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.879397 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.879544 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.879713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.879870 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.880024 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.880178 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.880821 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.880983 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.881129 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.881273 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.881418 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.881579 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.881734 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.881879 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.882031 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.882177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.882329 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.882492 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.882638 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.882790 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.882942 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.883087 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.883278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.883439 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.883602 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.883772 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.883917 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.884062 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.884220 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.884384 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.884531 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.884675 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.884826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.884971 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.885115 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.885273 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.885437 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.885592 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.885744 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.885896 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.886050 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.886202 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.886347 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.886491 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.886643 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.886643 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.886938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.887084 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.887248 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.887562 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.887800 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.887948 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.888181 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.888352 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.888506 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.888660 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.888805 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.888956 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.889111 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.889256 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.889401 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.889545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.889715 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.889874 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.890026 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.890430 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.890584 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.890730 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.890876 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.891029 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.891181 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.891325 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.891477 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.891648 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.891802 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.891978 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.892133 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.892287 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.892432 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.892582 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.892735 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.892890 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.893043 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.893188 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.893341 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.893494 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.893653 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.893819 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.893971 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.894115 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.894266 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.894411 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.894569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.894722 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.894874 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.895035 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.895187 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.895333 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.895486 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.895657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.895832 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.896015 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.896177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.896324 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.896483 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.896628 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.896780 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.896925 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.897078 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.897243 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.897394 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.897731 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.897892 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.898056 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.898203 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.898203 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.898495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.898641 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.898792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.898942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.899100 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.899261 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.899412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.899574 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.899774 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.899927 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.900099 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.900356 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.900539 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.900702 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.900702 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.900988 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.901153 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.901314 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.901473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.901702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.901870 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.902028 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.902198 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.902352 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.902503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.902652 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.902815 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.902974 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.903132 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.903283 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.903441 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.903592 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.903790 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.903944 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.904102 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.904311 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.904465 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.904630 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.904790 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.904943 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.905094 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.905253 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.905404 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.905571 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.905731 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.905897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.906055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.906206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.906368 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.906533 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.906685 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.906835 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.906992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.907151 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.907312 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.907479 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.907683 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.908030 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.908192 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.908344 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.908504 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.908668 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.908826 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.908985 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.909138 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.909295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.909460 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.909620 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.909772 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.909929 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.910089 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.910308 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.910471 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.910634 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.910785 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.910943 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.911139 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.911298 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.911465 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.912158 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.912329 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.912483 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.912637 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.912798 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.912951 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.913096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.913261 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.913407 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.913552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.913706 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.913859 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.914025 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.914025 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.914314 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.914459 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.914613 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.914759 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.914906 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.915058 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.915214 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.915368 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.915513 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.915722 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.915874 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.916032 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.916177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.916335 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.916488 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.916647 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.916799 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.916955 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.917108 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.917289 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.917462 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.917614 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.917765 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.918104 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.918275 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.918442 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.918596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.918756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.918908 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.919060 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.919220 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.919372 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.919541 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.919754 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.919914 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.920067 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.920067 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.920368 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.920519 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.920668 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.920825 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.920986 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.921147 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.921147 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.921453 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.921612 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.921764 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.921921 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.922086 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.922245 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.922405 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.922557 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.922715 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.922880 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.923031 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.923190 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.923350 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.923520 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.923707 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.923879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.924031 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.924181 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.924340 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.924499 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.924651 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.924811 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.924972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.925132 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.925284 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.925443 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.925613 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.925774 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.925936 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.926095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.926247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.926406 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.926599 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.926759 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.926919 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.927070 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.927272 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.927441 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.927604 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.927799 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.927951 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.928282 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.928453 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.928615 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.928776 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.928935 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.929094 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.929248 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.929398 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.929550 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.929717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.929887 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.930039 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.930197 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.930348 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.930513 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.930682 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.930841 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.930993 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.931150 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.931150 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.931446 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.931598 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.931806 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.931984 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.932144 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.932302 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.932462 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.932613 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.932765 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.932956 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.933126 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.935776 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.935963 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.936126 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.936288 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.936450 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.936617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.936843 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.937009 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.937171 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.937343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.937513 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.937666 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.937818 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.937972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.938132 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.938491 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.938663 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.938825 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.938990 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.939142 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.939293 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.939452 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.939668 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.939832 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.939999 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.940161 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.940313 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.940478 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.940631 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.940781 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.940932 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.941103 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.941256 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.941427 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.941580 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.941738 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.941891 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.942042 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.942194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.942359 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.942520 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.942672 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.943344 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.943521 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.943694 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.943923 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.944078 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.944231 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.944382 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.944533 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.944697 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.944856 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.945016 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.945177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.945338 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.945498 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.945678 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.945678 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.945975 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.946134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.946294 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.946294 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.946596 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.946749 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.946900 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.947059 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.947211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.947362 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.947523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.947736 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.947896 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.948048 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.948199 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.948384 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.948701 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.948869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.949021 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.949181 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.949333 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.949496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.949656 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.949827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.949978 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.950137 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.950288 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.950454 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.950615 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.950767 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.950918 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.951076 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.951228 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.951387 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.951548 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.951767 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.951944 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.952098 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.952259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.952419 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.952571 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.952724 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.952874 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.953032 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.953199 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.953361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.953521 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.953674 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.953824 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.953993 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.954158 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.954320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.954479 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.954638 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.954791 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.954942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.954942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.955245 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.955397 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.955555 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.955759 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.955925 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.956089 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.956239 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.956389 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.956540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.956690 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.956854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.957008 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.957159 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.957310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.957468 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.957620 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.957793 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.957959 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.958119 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.958271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.958444 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.958651 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.958973 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.959144 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.959297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.959456 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.959634 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.959812 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.959969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.960121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.960282 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.960441 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.960592 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.960756 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.960909 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.961071 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.961233 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.961393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.961552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.961712 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.961865 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.962015 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.962168 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.962337 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.962489 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.962670 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.962951 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.963127 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.963291 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.963444 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.963604 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.963782 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.963935 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.964097 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.964250 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.964408 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.964583 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.964684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.964774 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.964868 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.964957 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.965057 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.965154 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.965237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.965309 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.965382 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.965467 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.965543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.965629 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.965710 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.965790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.965864 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.965936 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966015 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966089 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966248 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966328 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966409 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966491 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966565 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966565 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966692 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966692 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.966968 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.967047 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.967121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.967193 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.967264 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.967344 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.967418 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.967497 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.967578 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.967692 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.967790 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.967872 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.967947 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.968027 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.968107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.968190 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.968277 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.968362 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.968436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.968508 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.968580 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.968580 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.968732 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.968814 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.968907 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969008 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969093 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969179 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969260 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969333 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969405 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969405 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969546 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969620 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969699 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969699 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969699 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969699 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.969699 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970006 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970079 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970156 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970230 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970314 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970408 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970489 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970649 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970731 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970813 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970894 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.970972 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.971045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.971123 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.971204 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.971291 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.971366 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.971437 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.971516 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.971596 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.971705 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.971797 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.971878 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.971951 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972029 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972109 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972193 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972266 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972338 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972408 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972480 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972551 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972630 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972709 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972788 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.972959 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973033 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973117 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973191 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973262 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973342 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973416 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973487 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973566 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973646 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973719 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973860 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.973931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.974014 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.974883 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.974973 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.975048 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.975121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.975202 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.975284 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.975357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.975429 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.975500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.975571 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.975697 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.975776 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.975848 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.976532 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.976532 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.976839 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.977103 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.977264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.977264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.977569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.977737 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.977905 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.978059 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.978220 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.978392 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.978583 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.978739 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.978907 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.979060 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.979211 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.979370 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.979656 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.979820 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.979991 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.980145 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.980298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.980450 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.980600 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.980752 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.980913 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.981066 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.981218 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.981378 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.981532 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.981708 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.981861 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.982022 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.982183 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.982336 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.982488 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.982648 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.982809 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.982809 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.983097 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.983097 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.983407 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.983585 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.983828 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.984117 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.984291 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.984445 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.984610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.984610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.985095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.985257 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.985409 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.985570 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.985733 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.985898 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.986050 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.986204 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.986355 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.986507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.986735 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.986899 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.987059 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.987221 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.987373 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.987539 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.987722 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.987892 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.988057 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.988217 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.988461 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.988633 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.988794 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.988955 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.989115 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.989267 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.989267 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.989568 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.989568 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.989940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.989940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.990249 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.990417 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.990569 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.990721 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.990872 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.991024 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.991780 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.991975 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.992133 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.992294 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.992447 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.992608 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.992781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.992943 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.993105 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.993265 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.993418 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.993570 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.993722 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.993888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.994049 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.994211 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.994363 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.994514 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.994675 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.994847 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.995020 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.995335 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.995506 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.995720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.995895 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.996056 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.996208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.996369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.996521 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.996683 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.996683 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.996987 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.997151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.997309 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.997470 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.997631 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.997805 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.997968 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.998121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.998272 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.998423 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.998584 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.998745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.998900 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.999074 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.999241 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.999402 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.999563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.999762 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:22.999919 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.000078 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.000231 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.000389 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.000551 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.000704 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.000864 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.001017 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.001188 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.001341 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.001505 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.001666 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.001827 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.001990 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.002143 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.002402 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.002577 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.002734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.002887 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.003039 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.003191 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.003362 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.003523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.003708 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.003866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.004026 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.004179 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.004380 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.004534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.004685 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.004837 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.004837 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.005133 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.005973 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.006149 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.006302 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.006462 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.006615 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.006776 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.006929 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.007080 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.007239 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.007399 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.007551 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.007775 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.007932 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.008103 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.008263 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.008423 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.008575 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.008735 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.008888 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.009038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.009190 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.009342 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.009507 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.009507 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.009805 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.009957 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.010126 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.010287 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.010453 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.010616 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.010778 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.010931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.011121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.011279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.011447 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.011599 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.011777 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.011946 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.012100 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.012100 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.012412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.012566 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.012718 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.012869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.013028 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.013179 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.013339 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.013493 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.013644 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.013802 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.013961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.014132 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.014292 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.014445 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.014604 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.014756 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.014915 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.015078 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.015498 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.015698 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.015867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.016188 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.016368 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.016537 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.016690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.016850 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.017002 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.017160 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.017322 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.017482 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.017643 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.017801 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.017953 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.018113 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.018345 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.018511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.018670 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.018824 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.018982 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.019144 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.019297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.019457 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.019627 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.019822 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.019984 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.020150 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.020304 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.020463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.020631 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.020784 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.020980 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.021156 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.021310 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.021471 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.022228 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.022389 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.022542 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.022703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.022869 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.023035 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.023195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.023195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.023696 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.023856 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.024027 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.024183 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.024342 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.024495 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.024646 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.024812 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.025040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.025322 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.025498 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.025654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.025815 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.025984 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.026156 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.026496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.026666 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.026827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.026980 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.027147 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.027315 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.027476 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.027650 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.027822 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.027985 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.028148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.028301 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.028459 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.028459 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.028756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.028921 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.029074 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.029228 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.029390 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.029390 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.029678 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.029839 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.030004 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.030164 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.030327 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.030479 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.030638 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.030801 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.030963 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.031117 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.031268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.031431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.031592 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.031818 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.031979 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.032132 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.032282 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.032434 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.032613 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.032955 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.033118 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.033271 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.033432 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.033596 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.033757 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.033910 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.034069 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.034222 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.034373 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.034526 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.034686 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.034839 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.034990 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.035149 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.035302 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.035469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.035659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.035831 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.035993 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.036146 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.036305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.037182 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.037344 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.037504 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.037747 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.037854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.037944 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.038041 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.038135 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.038234 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.038330 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.038427 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.038516 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.038617 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.038706 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.038799 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.038888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.038975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.039072 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.039160 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.039247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.039334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.039421 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.039515 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.039627 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.039729 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.039819 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.039906 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.040000 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.040096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.040192 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.040281 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.040368 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.040454 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.040549 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.040637 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.040737 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.040832 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.040920 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.040920 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.041078 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.041178 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.041276 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.041372 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.041467 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.041556 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.041642 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.041742 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.041832 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.041915 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.041989 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.041989 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.042135 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.042222 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.042296 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.042375 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.042449 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.042521 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.042609 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.042684 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.042764 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.042859 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.042955 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.043043 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.043137 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.043232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.043320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.043406 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.043500 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.043582 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.043793 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.043885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.043969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.044050 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.044132 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.044220 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.044373 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.044456 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.044531 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.044603 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.044696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.044793 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.044882 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.044968 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.045055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.045141 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.045234 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.045331 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.045419 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.045512 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.045602 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.045695 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.045783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.045878 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.045973 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.046094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.046191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.046421 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.046544 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.046737 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.046833 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.047048 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.047169 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.047353 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.047473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.047598 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:25:23.047733 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.048001 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.048314 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.048625 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.048936 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.049253 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.049585 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.049900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.050208 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.050634 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.050950 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.051271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.051593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.051931 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.052333 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.052662 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.052978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.053303 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.053617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.053946 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.054291 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.054620 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.054946 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.055254 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.055560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.055891 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.056204 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.056524 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.056835 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.057139 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.057450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.057761 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.058065 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.058369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.058674 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.058980 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.059290 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.059594 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.059932 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.060225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.060530 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.060841 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.061143 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.061453 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.061760 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.062068 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.062369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.062674 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.063135 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.063311 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.063670 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.063993 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.064447 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.064763 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.065086 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.065407 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.065733 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.066058 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.066379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.066693 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.067028 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.067346 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.068276 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.068613 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.068930 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.069308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.069556 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.069888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.070214 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.070522 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.070850 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.071171 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.071496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.071840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.072156 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.072486 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.072801 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.073114 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.073433 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.073747 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.074058 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.074381 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.074702 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.075029 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.075347 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.075678 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.076007 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.076336 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.076688 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.077007 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.077352 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.077684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.078009 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.078325 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.078631 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:25:23.078877 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:25:23.111018 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO dbcounter [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] Registered counter for database nova_api Jun 16 00:25:23.131780 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_db.sqlalchemy.engines [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:25:23.138331 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writer thread running {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:25:23.141941 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO dbcounter [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] Registered counter for database nova_api Jun 16 00:25:23.162121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_db.sqlalchemy.engines [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:25:23.168827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writer thread running {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:25:23.196167 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.context [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f03a406-cd78-4a9a-b33f-da67f6bff5f7(cell1) {{(pid=129465) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 00:25:23.200300 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:25:23.201882 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:25:23.202662 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:25:23.204639 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:25:23.206623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO dbcounter [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] Registered counter for database nova_cell0 Jun 16 00:25:23.210473 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO dbcounter [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] Registered counter for database nova_cell1 Jun 16 00:25:23.217638 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_db.sqlalchemy.engines [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:25:23.219405 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_db.sqlalchemy.engines [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:25:23.225433 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writer thread running {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:25:23.227093 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.context [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f03a406-cd78-4a9a-b33f-da67f6bff5f7(cell1) {{(pid=129466) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 00:25:23.227524 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writer thread running {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:25:23.231260 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:25:23.232880 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:25:23.233671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:25:23.235655 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:25:23.237653 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO dbcounter [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] Registered counter for database nova_cell0 Jun 16 00:25:23.242078 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO dbcounter [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] Registered counter for database nova_cell1 Jun 16 00:25:23.249377 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_db.sqlalchemy.engines [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:25:23.251557 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_db.sqlalchemy.engines [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:25:23.256169 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writer thread running {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:25:23.373772 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO dbcounter [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] Registered counter for database nova_cell0 Jun 16 00:25:23.380883 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_db.sqlalchemy.engines [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:25:23.385389 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writer thread running {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:25:23.397554 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writer thread running {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:25:23.407600 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO dbcounter [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] Registered counter for database nova_cell0 Jun 16 00:25:23.415437 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_db.sqlalchemy.engines [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:25:23.419832 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writer thread running {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:25:23.700159 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: WARNING keystonemiddleware.auth_token [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:25:23.707416 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: WARNING keystonemiddleware.auth_token [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:25:23.736178 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: WARNING keystonemiddleware.auth_token [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:25:23.744057 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: WARNING keystonemiddleware.auth_token [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:25:24.048952 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: WARNING keystonemiddleware.auth_token [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:25:24.054892 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: WARNING keystonemiddleware.auth_token [None req-9cf2fb84-0425-4888-9113-14b6fcbd7cb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:25:24.060174 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55efccbae9c0 pid: 129465 (default app) Jun 16 00:25:24.089108 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: WARNING keystonemiddleware.auth_token [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:25:24.095154 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: WARNING keystonemiddleware.auth_token [None req-adc7bbed-897c-44ca-9e5f-07f2c39eee43 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:25:24.101029 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55efccbae9c0 pid: 129466 (default app) Jun 16 00:26:04.043508 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:04.044369 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:04.045078 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:04.045925 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:04.728025 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=3 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:04.729191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=3 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:04.729908 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=3 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:04.733098 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=3 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:06.014058 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-18f42d92-4278-490e-8866-a6f329b04a65 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Action: 'create', calling method: .version_select at 0x7f9581c68820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-75149910", "metadata": {"Type": "work"}}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:06.807047 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cd1dab0b-52af-4aed-9a5b-941c9a168278 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Action: 'create', calling method: .version_select at 0x7f9581c6b790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1166364041"}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:08.553760 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-cd1dab0b-52af-4aed-9a5b-941c9a168278 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.832386 Jun 16 00:26:08.555156 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1154 bytes} [Thu Jun 16 00:26:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3836 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 16 00:26:08.562737 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-40e396ea-99d2-49f9-9ec4-86973bd9ecfb tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] Calling method '.version_select at 0x7f9581b345e0>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:08.615347 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-18f42d92-4278-490e-8866-a6f329b04a65 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 4.588027 Jun 16 00:26:08.617214 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 1/2] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jun 16 00:26:04 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 4596 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 00:26:08.626690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-93074d45-9c68-4a4f-92a4-caa00e9c2841 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9581b2f670>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:08.717209 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-40e396ea-99d2-49f9-9ec4-86973bd9ecfb tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/70bd1f81-07f1-416f-a564-592a58e2fa05" status: 200 len: 349 microversion: 2.1 time: 0.159950 Jun 16 00:26:08.725430 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:08 2022] GET /compute/v2.1/os-volumes/70bd1f81-07f1-416f-a564-592a58e2fa05 => generated 349 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:08.730664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-018eab01-dcab-40ca-acc5-4fe7d7bced36 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Calling method '.version_select at 0x7f9581b34940>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:08.762510 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-93074d45-9c68-4a4f-92a4-caa00e9c2841 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761" status: 200 len: 345 microversion: 2.1 time: 0.143917 Jun 16 00:26:08.763590 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:08 2022] GET /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761 => generated 345 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:08.963322 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-018eab01-dcab-40ca-acc5-4fe7d7bced36 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179" status: 200 len: 351 microversion: 2.1 time: 0.236546 Jun 16 00:26:08.964505 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 3/5] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:08 2022] GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 => generated 351 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:09.775868 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6ed38751-5e2a-4a29-8012-da3088e620f6 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9581b2f790>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:09.909033 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6ed38751-5e2a-4a29-8012-da3088e620f6 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761" status: 200 len: 346 microversion: 2.1 time: 0.137042 Jun 16 00:26:09.910020 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 3/6] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:09 2022] GET /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761 => generated 346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:09.921681 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-26a918f9-6a99-401d-b9fa-bf464378ba07 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Action: 'create', calling method: .version_select at 0x7f9581b34dc0>, body: {"snapshot": {"volume_id": "0d8c39df-b692-4aaa-ab6d-9c97fb873761", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1837387850"}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:09.976698 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9330a547-b91d-454d-8e95-f1c58793db34 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Calling method '.version_select at 0x7f9581b2fe50>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:10.344039 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-26a918f9-6a99-401d-b9fa-bf464378ba07 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.427013 Jun 16 00:26:10.344587 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 4/7] 10.222.0.44 () {60 vars in 1161 bytes} [Thu Jun 16 00:26:09 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:10.354290 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f412e2b0-8a08-4aac-9607-41b5189e64d5 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9581b4ca60>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:10.420556 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9330a547-b91d-454d-8e95-f1c58793db34 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179" status: 200 len: 352 microversion: 2.1 time: 0.447696 Jun 16 00:26:10.421597 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:09 2022] GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 => generated 352 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:10.433738 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-23dc8787-fcb6-4f91-996f-3fda2493f5ae tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Calling method '.version_select at 0x7f9581b49550>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:10.533254 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f412e2b0-8a08-4aac-9607-41b5189e64d5 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94" status: 200 len: 287 microversion: 2.1 time: 0.182536 Jun 16 00:26:10.534126 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 5/9] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 16 00:26:10 2022] GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94 => generated 287 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:10.539275 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-027a52a1-c9d8-4e57-bff4-89d4a1ed955d tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] Calling method '.version_select at 0x7f9581b34ca0>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:10.607849 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-23dc8787-fcb6-4f91-996f-3fda2493f5ae tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179" status: 200 len: 352 microversion: 2.1 time: 0.177279 Jun 16 00:26:10.610526 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 5/10] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:10 2022] GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 => generated 352 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:10.629288 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f4ce6eb5-df0e-4d23-8b67-d591fbb0cea0 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9581b2fdc0>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:10.678448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-027a52a1-c9d8-4e57-bff4-89d4a1ed955d tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/8ed7e4af-b422-49b0-823c-02c34171194e" status: 200 len: 350 microversion: 2.1 time: 0.143284 Jun 16 00:26:10.679281 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 6/11] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:10 2022] GET /compute/v2.1/os-volumes/8ed7e4af-b422-49b0-823c-02c34171194e => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:10.683816 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0079a2df-8ecc-45c9-bcee-03d4c9286fc3 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Calling method '.version_select at 0x7f9581b34940>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:10.768782 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f4ce6eb5-df0e-4d23-8b67-d591fbb0cea0 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.156839 Jun 16 00:26:10.769821 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1139 bytes} [Thu Jun 16 00:26:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:10.802677 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0b054a5d-1d48-4d91-8d3a-8ba1904ab1dc tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9581b49790>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:10.916560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0079a2df-8ecc-45c9-bcee-03d4c9286fc3 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179" status: 202 len: 0 microversion: 2.1 time: 0.236151 Jun 16 00:26:10.917124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 16 00:26:10 2022] DELETE /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:26:11.021517 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1917308070", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:11.064677 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0b054a5d-1d48-4d91-8d3a-8ba1904ab1dc tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94" status: 200 len: 287 microversion: 2.1 time: 0.287621 Jun 16 00:26:11.066139 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 7/14] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 16 00:26:10 2022] GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94 => generated 287 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:26:11.071363 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ddd66e44-2088-41c4-94b3-04e8deff534e tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Calling method '.version_select at 0x7f9581b49c10>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:11.192835 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.network.neutron [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] validate_networks() for [('3cf90d58-ad38-4382-b77e-0ae17155955d', None, None, None, None, None)] {{(pid=129466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:26:11.218379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ddd66e44-2088-41c4-94b3-04e8deff534e tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179" status: 200 len: 351 microversion: 2.1 time: 0.150486 Jun 16 00:26:11.218941 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 8/15] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:11 2022] GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 => generated 351 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:12.077299 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c2223172-9c3a-4245-9161-4f94eee786d5 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9581b49ca0>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:12.132541 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c2223172-9c3a-4245-9161-4f94eee786d5 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94" status: 200 len: 287 microversion: 2.1 time: 0.059366 Jun 16 00:26:12.136609 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 9/16] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 16 00:26:12 2022] GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:12.171673 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Flavor limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:26:12.173697 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Image limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:26:12.174969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Flavor pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:26:12.175599 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Image pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:26:12.176250 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:26:12.194738 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:12.195446 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:12.198106 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:12.198825 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:12.236093 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7a473eec-2c1b-4712-9870-7d642f3d8112 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Calling method '.version_select at 0x7f9581b49790>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:12.250242 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Getting quotas for project 3f0f1114473045f899e99736ff9765df. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:26:12.258675 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Getting quotas for user 8a57c3f4e4d7479c9f301195cd9764cc and project 3f0f1114473045f899e99736ff9765df. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:26:12.282263 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Going to run 1 instances... {{(pid=129466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:26:12.287722 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:26:12.335392 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7a473eec-2c1b-4712-9870-7d642f3d8112 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179" status: 200 len: 351 microversion: 2.1 time: 0.108310 Jun 16 00:26:12.336418 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 10/17] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:12 2022] GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:26:12.392429 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-efbac116-d5f1-4fa4-b7c4-3c03b0dcae93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.474102 Jun 16 00:26:12.394806 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 8/18] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:26:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:26:12.404530 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0e38d7a0-7f42-456a-bab6-b13ef0c1a8f3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:12.406588 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0e38d7a0-7f42-456a-bab6-b13ef0c1a8f3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:12.581374 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0e38d7a0-7f42-456a-bab6-b13ef0c1a8f3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:12.598823 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0e38d7a0-7f42-456a-bab6-b13ef0c1a8f3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1222 microversion: 2.1 time: 0.197626 Jun 16 00:26:12.599632 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 11/19] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:12 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1222 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:12.673641 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-76988722", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:12.783593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.network.neutron [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] validate_networks() for [('3cf90d58-ad38-4382-b77e-0ae17155955d', None, None, None, None, None)] {{(pid=129466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:26:13.145696 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f43937e1-264b-4ef2-90b2-65e20e8571d6 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9581b06430>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:13.194843 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f43937e1-264b-4ef2-90b2-65e20e8571d6 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94" status: 200 len: 287 microversion: 2.1 time: 0.053674 Jun 16 00:26:13.197572 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 12/20] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 16 00:26:13 2022] GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:13.349377 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ba8f4d0c-333c-4f20-9da7-61bb3e5d56de tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Calling method '.version_select at 0x7f9581b17550>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:13.483944 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ba8f4d0c-333c-4f20-9da7-61bb3e5d56de tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179" status: 200 len: 351 microversion: 2.1 time: 0.138550 Jun 16 00:26:13.485455 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 13/21] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:13 2022] GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 => generated 351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:26:13.548322 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Flavor limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:26:13.548876 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Image limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:26:13.549243 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Flavor pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:26:13.549652 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Image pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:26:13.550063 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:26:13.563065 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:13.563523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:13.566314 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:13.566768 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:13.607964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Getting quotas for project 3f0f1114473045f899e99736ff9765df. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:26:13.616971 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Getting quotas for user 8a57c3f4e4d7479c9f301195cd9764cc and project 3f0f1114473045f899e99736ff9765df. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:26:13.656328 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Going to run 1 instances... {{(pid=129466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:26:13.660572 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:26:13.739834 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1378b6ed-fbf7-4b01-bd72-1de91b8a80c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.072725 Jun 16 00:26:13.745334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 9/22] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:26:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:26:13.753129 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-74d22072-2858-4e06-af8d-afbe632cea38 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:13.753754 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-74d22072-2858-4e06-af8d-afbe632cea38 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:13.899445 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-74d22072-2858-4e06-af8d-afbe632cea38 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:13.906951 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-74d22072-2858-4e06-af8d-afbe632cea38 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1220 microversion: 2.1 time: 0.160198 Jun 16 00:26:13.907920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 14/23] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:13 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1220 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:14.207783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a47e190e-5887-4c27-ad25-6a83cd661eb9 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f95809e21f0>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:14.293167 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a47e190e-5887-4c27-ad25-6a83cd661eb9 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94" status: 200 len: 287 microversion: 2.1 time: 0.090329 Jun 16 00:26:14.297905 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 10/24] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 16 00:26:14 2022] GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:14.496906 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d4d1fa19-f14a-42cb-9e59-7cfc8f89ba5c tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Calling method '.version_select at 0x7f9581b17ca0>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:14.667005 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d4d1fa19-f14a-42cb-9e59-7cfc8f89ba5c tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179" status: 200 len: 351 microversion: 2.1 time: 0.173650 Jun 16 00:26:14.667675 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 15/25] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:14 2022] GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 => generated 351 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:14.936802 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-17b1a93a-f871-469f-baee-d6c4b5d5a4cb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:14.941156 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-17b1a93a-f871-469f-baee-d6c4b5d5a4cb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:15.058440 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-17b1a93a-f871-469f-baee-d6c4b5d5a4cb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:15.076566 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-17b1a93a-f871-469f-baee-d6c4b5d5a4cb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1220 microversion: 2.1 time: 0.156405 Jun 16 00:26:15.077682 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 11/26] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:14 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1220 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:15.306468 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ad275abe-f43b-470c-8bff-5e032f4b731f tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9581b06430>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:15.378661 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ad275abe-f43b-470c-8bff-5e032f4b731f tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94" status: 200 len: 287 microversion: 2.1 time: 0.076342 Jun 16 00:26:15.379222 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 16/27] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 16 00:26:15 2022] GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:15.680817 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-57df70be-631b-4433-b5ec-f965549e2137 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Calling method '.version_select at 0x7f95809e2820>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:15.847447 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-57df70be-631b-4433-b5ec-f965549e2137 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179" status: 200 len: 351 microversion: 2.1 time: 0.170611 Jun 16 00:26:15.848076 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 12/28] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:15 2022] GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 => generated 351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:16.095192 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-03a7766e-2398-43d3-a369-ac171ca3cb6c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:16.096477 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-03a7766e-2398-43d3-a369-ac171ca3cb6c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:16.111693 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-03a7766e-2398-43d3-a369-ac171ca3cb6c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:16.117107 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-03a7766e-2398-43d3-a369-ac171ca3cb6c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:16.119638 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-03a7766e-2398-43d3-a369-ac171ca3cb6c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:16.128011 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-03a7766e-2398-43d3-a369-ac171ca3cb6c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:16.391741 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-14996866-5094-478c-bed5-695a297676ae tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f95809e6ca0>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:16.457930 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-14996866-5094-478c-bed5-695a297676ae tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94" status: 200 len: 287 microversion: 2.1 time: 0.070921 Jun 16 00:26:16.459208 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 13/29] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 16 00:26:16 2022] GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:26:16.532076 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-03a7766e-2398-43d3-a369-ac171ca3cb6c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:16.577861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-03a7766e-2398-43d3-a369-ac171ca3cb6c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1224 microversion: 2.1 time: 0.485954 Jun 16 00:26:16.582957 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 17/30] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:16 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1224 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:16.862337 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d9cb5db9-e9db-4806-9053-5eb72c5a77a4 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Calling method '.version_select at 0x7f9580a0dca0>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:16.989988 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d9cb5db9-e9db-4806-9053-5eb72c5a77a4 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179" status: 200 len: 351 microversion: 2.1 time: 0.133538 Jun 16 00:26:16.990980 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 14/31] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:16 2022] GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 => generated 351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:17.473836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-adf2eb49-7890-4518-9498-2bd17c722333 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9581a86dc0>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:17.564146 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-adf2eb49-7890-4518-9498-2bd17c722333 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94" status: 200 len: 288 microversion: 2.1 time: 0.097444 Jun 16 00:26:17.565153 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 18/32] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 16 00:26:17 2022] GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94 => generated 288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:26:17.575798 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-dfd8ff44-db3d-4bc5-a78b-869c33b75111 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9580a17430>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:17.600720 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-fd9c6aed-581d-4b93-b7bf-06d7d612d2b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:17.605092 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-fd9c6aed-581d-4b93-b7bf-06d7d612d2b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:17.637746 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fd9c6aed-581d-4b93-b7bf-06d7d612d2b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:17.638142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fd9c6aed-581d-4b93-b7bf-06d7d612d2b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:17.639082 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fd9c6aed-581d-4b93-b7bf-06d7d612d2b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:17.639536 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fd9c6aed-581d-4b93-b7bf-06d7d612d2b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:17.824811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-dfd8ff44-db3d-4bc5-a78b-869c33b75111 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94" status: 202 len: 0 microversion: 2.1 time: 0.253033 Jun 16 00:26:17.825378 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 15/33] 10.222.0.44 () {58 vars in 1253 bytes} [Thu Jun 16 00:26:17 2022] DELETE /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:26:17.833772 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d7ae4830-c00c-496e-8a88-e70798676a94 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9580a0dc10>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:17.912194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fd9c6aed-581d-4b93-b7bf-06d7d612d2b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:17.928321 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-fd9c6aed-581d-4b93-b7bf-06d7d612d2b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1272 microversion: 2.1 time: 0.333303 Jun 16 00:26:17.930674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 19/34] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:17 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1272 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:17.943341 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d7ae4830-c00c-496e-8a88-e70798676a94 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94" status: 200 len: 287 microversion: 2.1 time: 0.113170 Jun 16 00:26:17.944384 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 16/35] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 16 00:26:17 2022] GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94 => generated 287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:18.010906 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d8bb8bf5-83fe-4dcb-8ace-5e51e0b80523 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Calling method '.version_select at 0x7f9581a20310>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:18.161370 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d8bb8bf5-83fe-4dcb-8ace-5e51e0b80523 tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179" status: 200 len: 351 microversion: 2.1 time: 0.155051 Jun 16 00:26:18.164168 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 20/36] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:18 2022] GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 => generated 351 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:18.947445 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-68509306-7478-4bf8-be1f-5b688cfec83d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:18.948341 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-68509306-7478-4bf8-be1f-5b688cfec83d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:18.955920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d955b24d-338d-4357-a527-e48f6a7a20ae tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9581a20280>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:18.961398 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-68509306-7478-4bf8-be1f-5b688cfec83d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:18.961866 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-68509306-7478-4bf8-be1f-5b688cfec83d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:18.967865 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-68509306-7478-4bf8-be1f-5b688cfec83d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:18.969386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-68509306-7478-4bf8-be1f-5b688cfec83d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:19.006355 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-d955b24d-338d-4357-a527-e48f6a7a20ae tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] HTTP exception thrown: Snapshot 0bca4645-b05c-45b6-aced-77a02f6bbe94 could not be found. Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d955b24d-338d-4357-a527-e48f6a7a20ae tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Request method failure captured: Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94 HTTP/1.1 Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnicLTbKldWfImqEENrt4E2te4EVj6vWCWdR4-gagkQmH7er_A6RN_hFXlvMV-_6Bvgoquh0vaYK4bVOgR5K-GJBsqzDEw4Zgol8mzG0JMWlc47Q6ltxAvV2wWstzLS4bc7DmUPxmPeNXGrzDIQUbqp-9YzCMquDxLjOW0q8nhiaEuU Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 0c33c87aaefe432993340c02b0afb579 Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-995143554 Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:26:19.019279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c33c87aaefe432993340c02b0afb579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c33c87aaefe432993340c02b0afb579"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c33c87aaefe432993340c02b0afb579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c33c87aaefe432993340c02b0afb579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-VolumesSnapshotsTestJSON-995143554 Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 0c33c87aaefe432993340c02b0afb579 Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-995143554 Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-VolumesSnapshotsTestJSON-995143554-project Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: a7fc6e9a0b644be98b10f953e8532305 Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-VolumesSnapshotsTestJSON-995143554-project Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Snapshot 0bca4645-b05c-45b6-aced-77a02f6bbe94 could not be found. Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '0bca4645-b05c-45b6-aced-77a02f6bbe94'} Jun 16 00:26:19.020532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0bca4645-b05c-45b6-aced-77a02f6bbe94 could not be found. (HTTP 404) (Request-ID: req-9c6446bb-6ae6-4c16-ab3f-f636b47e2cf9) Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.021211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:26:19.022267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0bca4645-b05c-45b6-aced-77a02f6bbe94 could not be found. Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 00:26:19.023194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:26:19.024204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0bca4645-b05c-45b6-aced-77a02f6bbe94 could not be found. Jun 16 00:26:19.024204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.024204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:19.024204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.024204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:19.024204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:26:19.024204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:26:19.024204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:26:19.024204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:26:19.024204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0bca4645-b05c-45b6-aced-77a02f6bbe94 could not be found. Jun 16 00:26:19.024204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.028834 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d955b24d-338d-4357-a527-e48f6a7a20ae tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Returning 404 to user: Snapshot 0bca4645-b05c-45b6-aced-77a02f6bbe94 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:26:19.030471 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d955b24d-338d-4357-a527-e48f6a7a20ae tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94" status: 404 len: 111 microversion: 2.1 time: 0.079416 Jun 16 00:26:19.040409 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 21/37] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jun 16 00:26:18 2022] GET /compute/v2.1/os-snapshots/0bca4645-b05c-45b6-aced-77a02f6bbe94 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:26:19.069455 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-18e9d271-c5f2-46f3-8496-fe5b0d54d2ab tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f95819e4940>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:19.311466 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-18e9d271-c5f2-46f3-8496-fe5b0d54d2ab tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761" status: 202 len: 0 microversion: 2.1 time: 0.257105 Jun 16 00:26:19.319997 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 22/38] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 16 00:26:19 2022] DELETE /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:26:19.438629 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1772168362", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "networks": [{"uuid": "1348db3f-9ba3-4c1b-b05c-8c9d4d3ffa80"}]}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:19.745993 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] validate_networks() for [('1348db3f-9ba3-4c1b-b05c-8c9d4d3ffa80', None, None, None, None, None)] {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:26:19.780472 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-68509306-7478-4bf8-be1f-5b688cfec83d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:19.810395 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-68509306-7478-4bf8-be1f-5b688cfec83d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1278 microversion: 2.1 time: 0.867337 Jun 16 00:26:19.815355 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 17/39] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:18 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1278 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:19.838047 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0294e2be-4e6f-4099-bbd0-8bf31c6d154c tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Calling method '.version_select at 0x7f958091e1f0>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:19.899949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-0294e2be-4e6f-4099-bbd0-8bf31c6d154c tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] HTTP exception thrown: Volume 171d6fb3-678c-41ca-9281-d838f7ab8179 could not be found. Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0294e2be-4e6f-4099-bbd0-8bf31c6d154c tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Request method failure captured: Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 HTTP/1.1 Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnibGgAyjOqsBKCqIZ3DvlRSLC2RksgR9aQTNedMzPHaMJciDKVt-8cJIOVFk1gJy6Bhq6Y-AZoZW1kRy0ziEAlb5O8C8_7ol2v6VUYvblfUVYTMa4M-Mv53yiSMjc0R8ww36a1aj4aj7vhliRRY_GkqzrN0EW8_Cuk_HQTxaGCMz4A Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: de27b90e7b904729a7e43c799e0584cf Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-VolumesGetTestJSON-996908898 Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:26:19.906503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/de27b90e7b904729a7e43c799e0584cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_de27b90e7b904729a7e43c799e0584cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/de27b90e7b904729a7e43c799e0584cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/de27b90e7b904729a7e43c799e0584cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-VolumesGetTestJSON-996908898 Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: de27b90e7b904729a7e43c799e0584cf Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-VolumesGetTestJSON-996908898 Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-VolumesGetTestJSON-996908898-project Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: 0e1aa49762f340eea2a95e80bb0dbd24 Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-VolumesGetTestJSON-996908898-project Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Volume 171d6fb3-678c-41ca-9281-d838f7ab8179 could not be found. Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '171d6fb3-678c-41ca-9281-d838f7ab8179'} Jun 16 00:26:19.907696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 171d6fb3-678c-41ca-9281-d838f7ab8179 could not be found. (HTTP 404) (Request-ID: req-06db3733-d351-4392-8983-86d46e86a5c2) Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:19.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:26:19.909918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 171d6fb3-678c-41ca-9281-d838f7ab8179 could not be found. Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 00:26:19.911055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:26:19.913403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 171d6fb3-678c-41ca-9281-d838f7ab8179 could not be found. Jun 16 00:26:19.913403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.913403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:19.913403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.913403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:19.913403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:26:19.913403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:26:19.913403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:26:19.913403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:26:19.913403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 171d6fb3-678c-41ca-9281-d838f7ab8179 could not be found. Jun 16 00:26:19.913403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:19.916378 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0294e2be-4e6f-4099-bbd0-8bf31c6d154c tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] Returning 404 to user: Volume 171d6fb3-678c-41ca-9281-d838f7ab8179 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:26:19.917671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0294e2be-4e6f-4099-bbd0-8bf31c6d154c tempest-VolumesGetTestJSON-996908898 tempest-VolumesGetTestJSON-996908898-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179" status: 404 len: 109 microversion: 2.1 time: 0.099442 Jun 16 00:26:19.918750 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 18/40] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:19 2022] GET /compute/v2.1/os-volumes/171d6fb3-678c-41ca-9281-d838f7ab8179 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:26:19.927468 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-80749546-769c-4846-b581-e495371162e3 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9582518c10>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:20.005521 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-80749546-769c-4846-b581-e495371162e3 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] HTTP exception thrown: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-80749546-769c-4846-b581-e495371162e3 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Request method failure captured: Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761 HTTP/1.1 Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnicLTbKldWfImqEENrt4E2te4EVj6vWCWdR4-gagkQmH7er_A6RN_hFXlvMV-_6Bvgoquh0vaYK4bVOgR5K-GJBsqzDEw4Zgol8mzG0JMWlc47Q6ltxAvV2wWstzLS4bc7DmUPxmPeNXGrzDIQUbqp-9YzCMquDxLjOW0q8nhiaEuU Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 0c33c87aaefe432993340c02b0afb579 Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-995143554 Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:26:20.016466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c33c87aaefe432993340c02b0afb579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c33c87aaefe432993340c02b0afb579"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c33c87aaefe432993340c02b0afb579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c33c87aaefe432993340c02b0afb579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-VolumesSnapshotsTestJSON-995143554 Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 0c33c87aaefe432993340c02b0afb579 Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-995143554 Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-VolumesSnapshotsTestJSON-995143554-project Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: a7fc6e9a0b644be98b10f953e8532305 Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-VolumesSnapshotsTestJSON-995143554-project Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '0d8c39df-b692-4aaa-ab6d-9c97fb873761'} Jun 16 00:26:20.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. (HTTP 404) (Request-ID: req-e5097062-9dba-48ed-b934-b8741f23724e) Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:20.018369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:26:20.019361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 00:26:20.023511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:26:20.033728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.033728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.033728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:20.033728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.033728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:20.033728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:26:20.033728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:26:20.033728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:26:20.033728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:26:20.033728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.033728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.035800 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-80749546-769c-4846-b581-e495371162e3 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Returning 404 to user: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:26:20.035800 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-80749546-769c-4846-b581-e495371162e3 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761" status: 404 len: 109 microversion: 2.1 time: 0.115532 Jun 16 00:26:20.050184 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 19/41] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:19 2022] GET /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:26:20.060866 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-660c1599-dbfe-4742-ba6e-fffe4dddc823 tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] Calling method '.version_select at 0x7f9580916940>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:20.165470 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-660c1599-dbfe-4742-ba6e-fffe4dddc823 tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1f56c96b-7f97-4306-8b45-a4d235d17c70" status: 200 len: 351 microversion: 2.1 time: 0.123605 Jun 16 00:26:20.175463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 20/42] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:20 2022] GET /compute/v2.1/os-volumes/1f56c96b-7f97-4306-8b45-a4d235d17c70 => generated 351 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:20.181308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-869271f7-ce7b-41d9-a621-3a3e77a84966 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f95808b20d0>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:20.242532 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-869271f7-ce7b-41d9-a621-3a3e77a84966 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] HTTP exception thrown: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-869271f7-ce7b-41d9-a621-3a3e77a84966 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Request method failure captured: Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: DELETE /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761 HTTP/1.1 Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnicLTbKldWfImqEENrt4E2te4EVj6vWCWdR4-gagkQmH7er_A6RN_hFXlvMV-_6Bvgoquh0vaYK4bVOgR5K-GJBsqzDEw4Zgol8mzG0JMWlc47Q6ltxAvV2wWstzLS4bc7DmUPxmPeNXGrzDIQUbqp-9YzCMquDxLjOW0q8nhiaEuU Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 0c33c87aaefe432993340c02b0afb579 Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-995143554 Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:26:20.246853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c33c87aaefe432993340c02b0afb579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c33c87aaefe432993340c02b0afb579"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c33c87aaefe432993340c02b0afb579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c33c87aaefe432993340c02b0afb579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-VolumesSnapshotsTestJSON-995143554 Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 0c33c87aaefe432993340c02b0afb579 Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-995143554 Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-VolumesSnapshotsTestJSON-995143554-project Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: a7fc6e9a0b644be98b10f953e8532305 Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-VolumesSnapshotsTestJSON-995143554-project Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '0d8c39df-b692-4aaa-ab6d-9c97fb873761'} Jun 16 00:26:20.248038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. (HTTP 404) (Request-ID: req-098ecfae-cd4f-400d-9737-b6cf6be68fdc) Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:20.248677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:26:20.249734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 00:26:20.250671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-869271f7-ce7b-41d9-a621-3a3e77a84966 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Returning 404 to user: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-869271f7-ce7b-41d9-a621-3a3e77a84966 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761" status: 404 len: 109 microversion: 2.1 time: 0.071913 Jun 16 00:26:20.255703 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 21/43] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 16 00:26:20 2022] DELETE /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:26:20.278105 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a9775e9a-bfa8-43d7-a680-0401cbfd4d7a tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] Calling method '.version_select at 0x7f9580916670>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:20.554833 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a9775e9a-bfa8-43d7-a680-0401cbfd4d7a tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.299509 Jun 16 00:26:20.555544 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 22/44] 10.222.0.44 () {58 vars in 1133 bytes} [Thu Jun 16 00:26:20 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:20.579102 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-210a1b26-8526-4fe2-9e18-876c0aa7cd25 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Calling method '.version_select at 0x7f9582518940>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:20.670533 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-210a1b26-8526-4fe2-9e18-876c0aa7cd25 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] HTTP exception thrown: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-210a1b26-8526-4fe2-9e18-876c0aa7cd25 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Request method failure captured: Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761 HTTP/1.1 Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnicLTbKldWfImqEENrt4E2te4EVj6vWCWdR4-gagkQmH7er_A6RN_hFXlvMV-_6Bvgoquh0vaYK4bVOgR5K-GJBsqzDEw4Zgol8mzG0JMWlc47Q6ltxAvV2wWstzLS4bc7DmUPxmPeNXGrzDIQUbqp-9YzCMquDxLjOW0q8nhiaEuU Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 0c33c87aaefe432993340c02b0afb579 Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-995143554 Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:26:20.672510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c33c87aaefe432993340c02b0afb579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c33c87aaefe432993340c02b0afb579"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c33c87aaefe432993340c02b0afb579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c33c87aaefe432993340c02b0afb579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-VolumesSnapshotsTestJSON-995143554 Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 0c33c87aaefe432993340c02b0afb579 Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-995143554 Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-VolumesSnapshotsTestJSON-995143554-project Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: a7fc6e9a0b644be98b10f953e8532305 Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-VolumesSnapshotsTestJSON-995143554-project Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '0d8c39df-b692-4aaa-ab6d-9c97fb873761'} Jun 16 00:26:20.673596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. (HTTP 404) (Request-ID: req-8c2e10fd-a91d-4135-b8d2-e53ef2e9a256) Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:20.674844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:26:20.677956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 00:26:20.680326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-210a1b26-8526-4fe2-9e18-876c0aa7cd25 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] Returning 404 to user: Volume 0d8c39df-b692-4aaa-ab6d-9c97fb873761 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-210a1b26-8526-4fe2-9e18-876c0aa7cd25 tempest-VolumesSnapshotsTestJSON-995143554 tempest-VolumesSnapshotsTestJSON-995143554-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761" status: 404 len: 109 microversion: 2.1 time: 0.118255 Jun 16 00:26:20.681310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 23/45] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:26:20 2022] GET /compute/v2.1/os-volumes/0d8c39df-b692-4aaa-ab6d-9c97fb873761 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:26:20.685869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c3e197a5-f06a-4626-b379-5110de97f926 tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] Calling method '.version_select at 0x7f9580a17940>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:20.957191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c3e197a5-f06a-4626-b379-5110de97f926 tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.280360 Jun 16 00:26:20.958146 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 24/46] 10.222.0.44 () {58 vars in 1148 bytes} [Thu Jun 16 00:26:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:20.971594 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ccee8053-4c6c-46b9-8d60-6ebd718cf78b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:20.972356 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ccee8053-4c6c-46b9-8d60-6ebd718cf78b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:21.029420 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ccee8053-4c6c-46b9-8d60-6ebd718cf78b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:21.030070 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ccee8053-4c6c-46b9-8d60-6ebd718cf78b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:21.042915 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ccee8053-4c6c-46b9-8d60-6ebd718cf78b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:21.044505 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ccee8053-4c6c-46b9-8d60-6ebd718cf78b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:21.543625 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ccee8053-4c6c-46b9-8d60-6ebd718cf78b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:21.563596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ccee8053-4c6c-46b9-8d60-6ebd718cf78b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1278 microversion: 2.1 time: 0.603881 Jun 16 00:26:21.564499 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 25/47] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:20 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1278 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:21.596668 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3fbae44f-0d85-47a3-9170-41b313ba8152 tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] Calling method '.version_select at 0x7f9580916430>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:21.930017 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3fbae44f-0d85-47a3-9170-41b313ba8152 tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.346011 Jun 16 00:26:21.930584 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 26/48] 10.222.0.44 () {58 vars in 1133 bytes} [Thu Jun 16 00:26:21 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:21.941888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-52c0b39c-36e3-45f2-8d04-72948ab44060 tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] Calling method '.version_select at 0x7f95809e2c10>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:22.129498 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-52c0b39c-36e3-45f2-8d04-72948ab44060 tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.191089 Jun 16 00:26:22.131234 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 27/49] 10.222.0.44 () {58 vars in 1166 bytes} [Thu Jun 16 00:26:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:22.605381 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-52a7c7fb-f761-4969-a19a-cacb2b277c8d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Action: 'create', calling method: .version_select at 0x7f95808b2d30>, body: {"keypair": {"name": "tempest-keypair-1383426794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvwju1S2xRcxMIfaLxD4p1pYYirRMB/gsJE7TNu3u24DmtBQfx31ch2EYToeMikf/mbTEBgyAv2ydOJymuUkOEV+YM6+U7VYWWkX6623osIQMBZAF5ZgMpd7SfhDZn+4g=="}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:22.702174 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-52a7c7fb-f761-4969-a19a-cacb2b277c8d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Getting quotas for project 0a869108ba4446c4b767d186c5db253f. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:26:22.710469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-52a7c7fb-f761-4969-a19a-cacb2b277c8d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Getting quotas for user a6c145cb49f54dd88307f416ff1bb92b and project 0a869108ba4446c4b767d186c5db253f. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:26:22.801045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-52a7c7fb-f761-4969-a19a-cacb2b277c8d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.664816 Jun 16 00:26:22.804503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 28/50] 10.222.0.44 () {62 vars in 1199 bytes} [Thu Jun 16 00:26:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 671 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 00:26:22.847070 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0dbb418c-562b-4ec1-84a6-4944e52b1c98 tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] Calling method '.version_select at 0x7f9580916280>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:23.074693 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0dbb418c-562b-4ec1-84a6-4944e52b1c98 tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.268804 Jun 16 00:26:23.075940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 29/51] 10.222.0.44 () {58 vars in 1169 bytes} [Thu Jun 16 00:26:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:23.081150 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b92b9efd-10f0-4843-98a4-915699a1b4fc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:23.082196 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b92b9efd-10f0-4843-98a4-915699a1b4fc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:23.099524 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b92b9efd-10f0-4843-98a4-915699a1b4fc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:23.101012 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b92b9efd-10f0-4843-98a4-915699a1b4fc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:23.104211 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b92b9efd-10f0-4843-98a4-915699a1b4fc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:23.106473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b92b9efd-10f0-4843-98a4-915699a1b4fc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:23.580975 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=4 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:23.663437 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b92b9efd-10f0-4843-98a4-915699a1b4fc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:23.678600 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b92b9efd-10f0-4843-98a4-915699a1b4fc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1278 microversion: 2.1 time: 0.601268 Jun 16 00:26:23.680408 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 30/52] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:23 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1278 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:23.705540 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-940a6509-6a8c-40e8-9cc0-f9c2366d572b tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] Calling method '.version_select at 0x7f95809168b0>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:23.904307 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=4 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:23.980119 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-940a6509-6a8c-40e8-9cc0-f9c2366d572b tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.287649 Jun 16 00:26:23.984009 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 31/53] 10.222.0.44 () {58 vars in 1154 bytes} [Thu Jun 16 00:26:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:24.642434 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:26:24.643060 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:26:24.643685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:26:24.644318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:26:24.644842 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:26:24.650531 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-26a2aa36-6d72-490f-9b84-fafa9c0f0cd4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: .version_select at 0x7f95808bc9d0>, body: {"keypair": {"name": "tempest-keypair-268979143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrxnbB+VbbLPGgPXMNb/2PNtg+XEqfTX8Fq3muZ8cbI7qv1BM9X3t1WWNJhH1o+mo0UW6v64cRWPrhnVxt2c6cQwQuyzLHCbriGfkoLflXTRh2ZNs5+mAzmzB/Od7OQVA=="}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:24.688095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:24.688727 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:24.693189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:24.699204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:24.748756 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-26a2aa36-6d72-490f-9b84-fafa9c0f0cd4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for project def39ced63b64e3aa65c9542ae512e7e. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:26:24.766126 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-26a2aa36-6d72-490f-9b84-fafa9c0f0cd4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for user f0c5a5705f34440abce48190674a76d5 and project def39ced63b64e3aa65c9542ae512e7e. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:26:24.891526 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Getting quotas for project 516387296aef4322926e0ba1389aace0. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:26:24.934346 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Getting quotas for user 129de9f58bcf4766a7c15e932d5b92ff and project 516387296aef4322926e0ba1389aace0. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:26:24.957508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-26a2aa36-6d72-490f-9b84-fafa9c0f0cd4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.972373 Jun 16 00:26:24.966520 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 32/54] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 16 00:26:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:24.990039 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e5239444-7620-459f-8c66-98d259ebf5ae tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] Calling method '.version_select at 0x7f9580916dc0>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:25.005942 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:26:25.017871 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:26:25.388210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e5239444-7620-459f-8c66-98d259ebf5ae tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.413728 Jun 16 00:26:25.388210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 33/55] 10.222.0.44 () {58 vars in 1187 bytes} [Thu Jun 16 00:26:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:25.393163 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f94a2584-d953-4319-80aa-fe6e24f20689 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:25.393983 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f94a2584-d953-4319-80aa-fe6e24f20689 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:25.399110 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-cd189a0a-820e-4212-a59e-fb2528ec9707 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.077852 Jun 16 00:26:25.400333 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 23/56] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:26:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 6080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:26:25.405948 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f32686b8-a599-46cb-8e61-b612121d26db tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] Calling method '.version_select at 0x7f95810a20d0>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:25.421856 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f94a2584-d953-4319-80aa-fe6e24f20689 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:25.425467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f94a2584-d953-4319-80aa-fe6e24f20689 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:25.426694 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f94a2584-d953-4319-80aa-fe6e24f20689 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:25.427221 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f94a2584-d953-4319-80aa-fe6e24f20689 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:25.709543 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f32686b8-a599-46cb-8e61-b612121d26db tempest-VolumesTestJSON-19318078 tempest-VolumesTestJSON-19318078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.307809 Jun 16 00:26:25.710604 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 24/57] 10.222.0.44 () {58 vars in 1154 bytes} [Thu Jun 16 00:26:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:25.717479 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-36116539-e213-4e4b-bcbb-67882cd062e3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:25.718265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-36116539-e213-4e4b-bcbb-67882cd062e3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:26.182998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f94a2584-d953-4319-80aa-fe6e24f20689 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:26.199262 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f94a2584-d953-4319-80aa-fe6e24f20689 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1278 microversion: 2.1 time: 0.812629 Jun 16 00:26:26.201776 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 34/58] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:25 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1278 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:26.203073 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-36116539-e213-4e4b-bcbb-67882cd062e3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:26.227159 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-36116539-e213-4e4b-bcbb-67882cd062e3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1215 microversion: 2.1 time: 0.512228 Jun 16 00:26:26.232137 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 25/59] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:25 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1215 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:27.219725 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-18fa9564-951f-40fd-96b7-41796a16c255 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:27.221345 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-18fa9564-951f-40fd-96b7-41796a16c255 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:27.250127 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e4b56d2e-9f73-4f5e-b8d6-968f1686abc4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:27.254230 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e4b56d2e-9f73-4f5e-b8d6-968f1686abc4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:27.272684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-18fa9564-951f-40fd-96b7-41796a16c255 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:27.276034 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e4b56d2e-9f73-4f5e-b8d6-968f1686abc4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:27.276413 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-18fa9564-951f-40fd-96b7-41796a16c255 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:27.286909 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e4b56d2e-9f73-4f5e-b8d6-968f1686abc4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:27.289695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-18fa9564-951f-40fd-96b7-41796a16c255 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:27.292080 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-18fa9564-951f-40fd-96b7-41796a16c255 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:27.292637 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e4b56d2e-9f73-4f5e-b8d6-968f1686abc4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:27.295899 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e4b56d2e-9f73-4f5e-b8d6-968f1686abc4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:27.960981 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e4b56d2e-9f73-4f5e-b8d6-968f1686abc4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:27.972227 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e4b56d2e-9f73-4f5e-b8d6-968f1686abc4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1267 microversion: 2.1 time: 0.727826 Jun 16 00:26:27.986382 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 26/60] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:27 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1267 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:29.005234 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-fb46d051-55fe-473d-a516-9e9877f31a37 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:29.006647 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-fb46d051-55fe-473d-a516-9e9877f31a37 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:29.028170 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fb46d051-55fe-473d-a516-9e9877f31a37 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:29.030442 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fb46d051-55fe-473d-a516-9e9877f31a37 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:29.036486 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fb46d051-55fe-473d-a516-9e9877f31a37 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:29.037174 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fb46d051-55fe-473d-a516-9e9877f31a37 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:29.805294 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fb46d051-55fe-473d-a516-9e9877f31a37 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:29.828858 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-fb46d051-55fe-473d-a516-9e9877f31a37 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1273 microversion: 2.1 time: 0.827176 Jun 16 00:26:29.830045 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 27/61] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:28 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1273 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:30.200258 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-18fa9564-951f-40fd-96b7-41796a16c255 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:30.220785 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-18fa9564-951f-40fd-96b7-41796a16c255 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 3.004000 Jun 16 00:26:30.223677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 35/62] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:27 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 3010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:30.847384 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5b4a3552-8d98-4df0-b37f-2d2fd533ed26 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:30.848647 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5b4a3552-8d98-4df0-b37f-2d2fd533ed26 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:30.858528 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5b4a3552-8d98-4df0-b37f-2d2fd533ed26 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:30.861668 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5b4a3552-8d98-4df0-b37f-2d2fd533ed26 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:30.863928 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5b4a3552-8d98-4df0-b37f-2d2fd533ed26 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:30.865032 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5b4a3552-8d98-4df0-b37f-2d2fd533ed26 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:31.030827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1038636584", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f10bbc9d-0adc-443a-9210-2ffe6856cac7"}], "security_groups": [{"name": "tempest-securitygroup--464134476"}], "key_name": "tempest-keypair-1383426794", "user_data": "}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:31.494000 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.network.neutron [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] validate_networks() for [('f10bbc9d-0adc-443a-9210-2ffe6856cac7', None, None, None, None, None)] {{(pid=129466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:26:32.921707 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5b4a3552-8d98-4df0-b37f-2d2fd533ed26 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:32.940774 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5b4a3552-8d98-4df0-b37f-2d2fd533ed26 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 2.097808 Jun 16 00:26:32.942134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 28/63] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:30 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:32.951412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c2effc52-d0ea-4076-9f59-ba56b3d41f64 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:32.953686 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c2effc52-d0ea-4076-9f59-ba56b3d41f64 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:32.973286 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c2effc52-d0ea-4076-9f59-ba56b3d41f64 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:32.975502 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c2effc52-d0ea-4076-9f59-ba56b3d41f64 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:32.983330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c2effc52-d0ea-4076-9f59-ba56b3d41f64 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:32.984267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c2effc52-d0ea-4076-9f59-ba56b3d41f64 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:34.790312 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:34.807646 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=22 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:35.676584 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Flavor limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:26:35.677022 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Image limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:26:35.677546 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Flavor pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:26:35.678086 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Image pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:26:35.679376 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:26:35.682216 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=8 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:35.694079 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c2effc52-d0ea-4076-9f59-ba56b3d41f64 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:35.721225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:35.721716 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:35.722645 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c2effc52-d0ea-4076-9f59-ba56b3d41f64 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 2.764379 Jun 16 00:26:35.733404 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:35.736597 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 29/64] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:32 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 2793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:35.744661 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-dd183771-d00d-4994-9bde-5aab5d6bf372 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:35.745670 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-dd183771-d00d-4994-9bde-5aab5d6bf372 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:35.745803 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:35.755225 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:35.763133 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dd183771-d00d-4994-9bde-5aab5d6bf372 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:35.764392 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dd183771-d00d-4994-9bde-5aab5d6bf372 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:35.765669 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dd183771-d00d-4994-9bde-5aab5d6bf372 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:35.767297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dd183771-d00d-4994-9bde-5aab5d6bf372 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:35.793865 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=35 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:35.828382 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Getting quotas for project 0a869108ba4446c4b767d186c5db253f. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:26:35.841625 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Getting quotas for user a6c145cb49f54dd88307f416ff1bb92b and project 0a869108ba4446c4b767d186c5db253f. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:26:35.870815 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Going to run 1 instances... {{(pid=129466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:26:35.879319 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:26:36.024259 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e76118b5-996b-4d0e-b727-2e1dac9946f9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.997843 Jun 16 00:26:36.025304 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 36/65] 10.222.0.44 () {62 vars in 1187 bytes} [Thu Jun 16 00:26:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 5000 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 16 00:26:36.219035 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=8 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:36.283890 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-dd183771-d00d-4994-9bde-5aab5d6bf372 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:36.291534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-dd183771-d00d-4994-9bde-5aab5d6bf372 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.553569 Jun 16 00:26:36.301712 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 30/66] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:35 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:36.410878 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-7625031d-90e1-4366-ab01-40a3813ed2e6 req-718ecf12-82ae-49a2-bb98-2d1b2ed47cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4", "tag": "bd914ca3-f036-4016-bdf2-f6dffc6a5655"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:36.437323 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-7625031d-90e1-4366-ab01-40a3813ed2e6 req-718ecf12-82ae-49a2-bb98-2d1b2ed47cba service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:36.439459 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-7625031d-90e1-4366-ab01-40a3813ed2e6 req-718ecf12-82ae-49a2-bb98-2d1b2ed47cba service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:36.489372 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-7625031d-90e1-4366-ab01-40a3813ed2e6 req-718ecf12-82ae-49a2-bb98-2d1b2ed47cba service nova] Creating event network-changed:bd914ca3-f036-4016-bdf2-f6dffc6a5655 for instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 on hv-cinder-84327 Jun 16 00:26:36.490415 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-7625031d-90e1-4366-ab01-40a3813ed2e6 req-718ecf12-82ae-49a2-bb98-2d1b2ed47cba service nova] Acquired lock "compute-rpcapi-router" {{(pid=129466) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 00:26:36.492563 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e7ea93ba-5dc1-4055-927e-3aab6c3c1967 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:36.494134 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e7ea93ba-5dc1-4055-927e-3aab6c3c1967 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:36.495697 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e7ea93ba-5dc1-4055-927e-3aab6c3c1967 None None] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:36.496797 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e7ea93ba-5dc1-4055-927e-3aab6c3c1967 None None] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:36.509172 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.compute.rpcapi [None req-e7ea93ba-5dc1-4055-927e-3aab6c3c1967 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 00:26:36.510401 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e7ea93ba-5dc1-4055-927e-3aab6c3c1967 None None] Releasing lock "compute-rpcapi-router" {{(pid=129466) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 00:26:36.568814 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e7ea93ba-5dc1-4055-927e-3aab6c3c1967 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.541153 Jun 16 00:26:36.570021 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 37/67] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:36.576318 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e78bc3f4-71ea-49e4-a2ce-019e31001ea0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:36.582638 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e78bc3f4-71ea-49e4-a2ce-019e31001ea0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:36.664053 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-0d7b5cfb-ae49-4591-8c64-6c9c088b148a req-83ecd24e-abef-42d8-8fc8-8d500bca17f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3", "tag": "832d8e05-6171-438e-bdb8-0ab9ae6c2efe"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:36.684864 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-0d7b5cfb-ae49-4591-8c64-6c9c088b148a req-83ecd24e-abef-42d8-8fc8-8d500bca17f7 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:36.685357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-0d7b5cfb-ae49-4591-8c64-6c9c088b148a req-83ecd24e-abef-42d8-8fc8-8d500bca17f7 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:36.751300 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-0d7b5cfb-ae49-4591-8c64-6c9c088b148a req-83ecd24e-abef-42d8-8fc8-8d500bca17f7 service nova] Creating event network-changed:832d8e05-6171-438e-bdb8-0ab9ae6c2efe for instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 on hv-cinder-84327 Jun 16 00:26:36.751958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-0d7b5cfb-ae49-4591-8c64-6c9c088b148a req-83ecd24e-abef-42d8-8fc8-8d500bca17f7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129465) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 00:26:36.753288 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d418f5f-eea6-4683-9814-4ace0bf0e774 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:36.757118 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e78bc3f4-71ea-49e4-a2ce-019e31001ea0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:36.765694 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d418f5f-eea6-4683-9814-4ace0bf0e774 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:36.769158 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d418f5f-eea6-4683-9814-4ace0bf0e774 None None] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:36.770528 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e78bc3f4-71ea-49e4-a2ce-019e31001ea0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:36.771022 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d418f5f-eea6-4683-9814-4ace0bf0e774 None None] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:36.776887 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e78bc3f4-71ea-49e4-a2ce-019e31001ea0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:36.779568 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e78bc3f4-71ea-49e4-a2ce-019e31001ea0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1282 microversion: 2.20 time: 0.208196 Jun 16 00:26:36.794757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.compute.rpcapi [None req-0d418f5f-eea6-4683-9814-4ace0bf0e774 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 00:26:36.799973 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 38/68] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:36 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1282 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:36.810360 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0fd8328b-7ef5-44de-a9e4-38fd284e475d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:36.812324 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d418f5f-eea6-4683-9814-4ace0bf0e774 None None] Releasing lock "compute-rpcapi-router" {{(pid=129465) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 00:26:36.813943 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0fd8328b-7ef5-44de-a9e4-38fd284e475d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:36.826045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0fd8328b-7ef5-44de-a9e4-38fd284e475d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:36.827425 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0fd8328b-7ef5-44de-a9e4-38fd284e475d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:36.828367 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0fd8328b-7ef5-44de-a9e4-38fd284e475d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:36.830476 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0fd8328b-7ef5-44de-a9e4-38fd284e475d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:36.848804 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0d418f5f-eea6-4683-9814-4ace0bf0e774 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.544477 Jun 16 00:26:36.849425 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 31/69] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:36.991466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0fd8328b-7ef5-44de-a9e4-38fd284e475d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:36.999405 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0fd8328b-7ef5-44de-a9e4-38fd284e475d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.195978 Jun 16 00:26:37.000799 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 39/70] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:36 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:37.095335 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2044753931", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a813215-bb6e-4258-9089-1e234ad6c22c"}], "security_groups": [{"name": "tempest-securitygroup--640117867"}], "key_name": "tempest-keypair-268979143", "user_data": "}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:37.254378 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] validate_networks() for [('0a813215-bb6e-4258-9089-1e234ad6c22c', None, None, None, None, None)] {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:26:37.319691 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e6657910-2072-4841-8096-b8bc827443d3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:37.320631 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e6657910-2072-4841-8096-b8bc827443d3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:37.330874 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e6657910-2072-4841-8096-b8bc827443d3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:37.331491 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e6657910-2072-4841-8096-b8bc827443d3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:37.332491 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e6657910-2072-4841-8096-b8bc827443d3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:37.333107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e6657910-2072-4841-8096-b8bc827443d3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:38.135283 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e6657910-2072-4841-8096-b8bc827443d3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:38.156168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e6657910-2072-4841-8096-b8bc827443d3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.840945 Jun 16 00:26:38.162400 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 40/71] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:37 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:38.183078 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2c78cf12-6182-4f66-a6d9-5a1a55addb75 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:38.184281 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2c78cf12-6182-4f66-a6d9-5a1a55addb75 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:38.214562 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2c78cf12-6182-4f66-a6d9-5a1a55addb75 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:38.215151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2c78cf12-6182-4f66-a6d9-5a1a55addb75 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:38.215966 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2c78cf12-6182-4f66-a6d9-5a1a55addb75 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:38.216401 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2c78cf12-6182-4f66-a6d9-5a1a55addb75 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:38.410541 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2c78cf12-6182-4f66-a6d9-5a1a55addb75 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:38.419985 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2c78cf12-6182-4f66-a6d9-5a1a55addb75 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:38.421807 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2c78cf12-6182-4f66-a6d9-5a1a55addb75 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:38.423485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2c78cf12-6182-4f66-a6d9-5a1a55addb75 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1334 microversion: 2.20 time: 0.258439 Jun 16 00:26:38.424900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 41/72] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:38 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1334 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:38.434838 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f254e027-01eb-4540-b6a9-64d9fb688a69 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:38.436480 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f254e027-01eb-4540-b6a9-64d9fb688a69 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:38.442619 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f254e027-01eb-4540-b6a9-64d9fb688a69 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:38.443072 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f254e027-01eb-4540-b6a9-64d9fb688a69 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:38.443890 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f254e027-01eb-4540-b6a9-64d9fb688a69 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:38.444327 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f254e027-01eb-4540-b6a9-64d9fb688a69 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:38.561633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:26:38.564208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:26:38.564867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:26:38.565556 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:26:38.566126 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:26:38.588702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:38.589405 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:38.592954 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:38.593447 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:38.628167 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for project def39ced63b64e3aa65c9542ae512e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:26:38.636200 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for user f0c5a5705f34440abce48190674a76d5 and project def39ced63b64e3aa65c9542ae512e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:26:38.645191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f254e027-01eb-4540-b6a9-64d9fb688a69 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:38.653456 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f254e027-01eb-4540-b6a9-64d9fb688a69 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.227366 Jun 16 00:26:38.654711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 42/73] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:38 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:38.660964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-1e59e679-96e3-4b9f-a497-dddc1fc4c584 req-c2b763bb-7a30-4d81-954b-0269020911bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8388df29-a591-4d4c-a77f-530d3f0e4693", "tag": "d9340f41-2f9e-42a9-aa33-4159ff99dd6b"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:38.668208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:26:38.670372 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-1e59e679-96e3-4b9f-a497-dddc1fc4c584 req-c2b763bb-7a30-4d81-954b-0269020911bb service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:38.671091 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-1e59e679-96e3-4b9f-a497-dddc1fc4c584 req-c2b763bb-7a30-4d81-954b-0269020911bb service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:38.674165 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:26:38.684433 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-1e59e679-96e3-4b9f-a497-dddc1fc4c584 req-c2b763bb-7a30-4d81-954b-0269020911bb service nova] Creating event network-changed:d9340f41-2f9e-42a9-aa33-4159ff99dd6b for instance 8388df29-a591-4d4c-a77f-530d3f0e4693 on hv-cinder-84327 Jun 16 00:26:38.691104 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-1e59e679-96e3-4b9f-a497-dddc1fc4c584 req-c2b763bb-7a30-4d81-954b-0269020911bb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034950 Jun 16 00:26:38.692549 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 43/74] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:38.751740 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e419bf30-40a8-4741-9a10-dd5699853193 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.663202 Jun 16 00:26:38.753309 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 32/75] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:26:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:26:38.763988 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-922a4a4f-bf09-461b-bc50-6001e6fbb78e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:38.764691 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-922a4a4f-bf09-461b-bc50-6001e6fbb78e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:38.957399 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-922a4a4f-bf09-461b-bc50-6001e6fbb78e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:38.974336 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-922a4a4f-bf09-461b-bc50-6001e6fbb78e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1241 microversion: 2.1 time: 0.215046 Jun 16 00:26:38.987333 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 44/76] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:38 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1241 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:39.179222 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1807cc4d-f17a-4e1f-ae3d-295b9bc6db02 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:39.179870 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1807cc4d-f17a-4e1f-ae3d-295b9bc6db02 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:39.194357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1807cc4d-f17a-4e1f-ae3d-295b9bc6db02 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:39.196286 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1807cc4d-f17a-4e1f-ae3d-295b9bc6db02 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:39.197129 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1807cc4d-f17a-4e1f-ae3d-295b9bc6db02 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:39.197573 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1807cc4d-f17a-4e1f-ae3d-295b9bc6db02 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:39.386972 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1807cc4d-f17a-4e1f-ae3d-295b9bc6db02 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:39.399998 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1807cc4d-f17a-4e1f-ae3d-295b9bc6db02 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.224715 Jun 16 00:26:39.401173 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 33/77] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:39 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:39.445855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4c8bc9ee-9338-4ce5-88db-348416d85091 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:39.445855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4c8bc9ee-9338-4ce5-88db-348416d85091 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:39.453083 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4c8bc9ee-9338-4ce5-88db-348416d85091 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:39.453855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4c8bc9ee-9338-4ce5-88db-348416d85091 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:39.459691 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4c8bc9ee-9338-4ce5-88db-348416d85091 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:39.460398 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4c8bc9ee-9338-4ce5-88db-348416d85091 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:39.562850 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4c8bc9ee-9338-4ce5-88db-348416d85091 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:39.573512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4c8bc9ee-9338-4ce5-88db-348416d85091 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:39.575475 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4c8bc9ee-9338-4ce5-88db-348416d85091 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:39.577359 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4c8bc9ee-9338-4ce5-88db-348416d85091 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1340 microversion: 2.20 time: 0.138806 Jun 16 00:26:39.578555 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 45/78] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:39 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1340 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:39.671938 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c0b719d4-c850-44ef-9bea-f625ff90de95 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:39.672830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c0b719d4-c850-44ef-9bea-f625ff90de95 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:39.678923 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c0b719d4-c850-44ef-9bea-f625ff90de95 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:39.679500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c0b719d4-c850-44ef-9bea-f625ff90de95 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:39.680360 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c0b719d4-c850-44ef-9bea-f625ff90de95 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:39.680941 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c0b719d4-c850-44ef-9bea-f625ff90de95 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:39.822966 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c0b719d4-c850-44ef-9bea-f625ff90de95 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:39.830898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c0b719d4-c850-44ef-9bea-f625ff90de95 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.163908 Jun 16 00:26:39.840587 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 34/79] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:39 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:39.995305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-bb14281f-b6ea-430a-bad7-ef87bdee0aa1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:39.996232 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-bb14281f-b6ea-430a-bad7-ef87bdee0aa1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:40.005446 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bb14281f-b6ea-430a-bad7-ef87bdee0aa1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:40.006117 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bb14281f-b6ea-430a-bad7-ef87bdee0aa1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:40.007054 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bb14281f-b6ea-430a-bad7-ef87bdee0aa1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:40.007710 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bb14281f-b6ea-430a-bad7-ef87bdee0aa1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:40.099256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-bb14281f-b6ea-430a-bad7-ef87bdee0aa1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:40.107983 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-bb14281f-b6ea-430a-bad7-ef87bdee0aa1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.117840 Jun 16 00:26:40.108630 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 46/80] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:39 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:40.419378 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4fd1e33e-fa38-4c0f-a70f-f59aee64febe tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:40.420029 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4fd1e33e-fa38-4c0f-a70f-f59aee64febe tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:40.426794 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4fd1e33e-fa38-4c0f-a70f-f59aee64febe tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:40.427432 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4fd1e33e-fa38-4c0f-a70f-f59aee64febe tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:40.428311 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4fd1e33e-fa38-4c0f-a70f-f59aee64febe tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:40.428854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4fd1e33e-fa38-4c0f-a70f-f59aee64febe tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:40.583783 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4fd1e33e-fa38-4c0f-a70f-f59aee64febe tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:40.591209 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4fd1e33e-fa38-4c0f-a70f-f59aee64febe tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.176806 Jun 16 00:26:40.600336 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8b5c7ab3-c11e-4c71-9735-44241599b5cc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:40.600895 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 35/81] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:40 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:40.601235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8b5c7ab3-c11e-4c71-9735-44241599b5cc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:40.609434 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8b5c7ab3-c11e-4c71-9735-44241599b5cc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:40.610667 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8b5c7ab3-c11e-4c71-9735-44241599b5cc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:40.612274 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8b5c7ab3-c11e-4c71-9735-44241599b5cc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:40.612932 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8b5c7ab3-c11e-4c71-9735-44241599b5cc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:40.708059 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8b5c7ab3-c11e-4c71-9735-44241599b5cc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:40.717735 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8b5c7ab3-c11e-4c71-9735-44241599b5cc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:40.719909 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8b5c7ab3-c11e-4c71-9735-44241599b5cc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:40.721117 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8b5c7ab3-c11e-4c71-9735-44241599b5cc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1340 microversion: 2.20 time: 0.128239 Jun 16 00:26:40.721853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 47/82] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:40 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1340 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:26:40.848899 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3f67a3a9-7461-42c1-8caf-2fc9295393e5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:40.850314 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3f67a3a9-7461-42c1-8caf-2fc9295393e5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:40.858392 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3f67a3a9-7461-42c1-8caf-2fc9295393e5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:40.858993 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3f67a3a9-7461-42c1-8caf-2fc9295393e5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:40.860588 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3f67a3a9-7461-42c1-8caf-2fc9295393e5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:40.861012 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3f67a3a9-7461-42c1-8caf-2fc9295393e5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:41.002284 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3f67a3a9-7461-42c1-8caf-2fc9295393e5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:41.010389 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3f67a3a9-7461-42c1-8caf-2fc9295393e5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.166723 Jun 16 00:26:41.010958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 36/83] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:40 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:41.131684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-95b3f5e1-d7b1-4b56-9b00-70d69c0470e6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:41.132304 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-95b3f5e1-d7b1-4b56-9b00-70d69c0470e6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:41.143391 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-95b3f5e1-d7b1-4b56-9b00-70d69c0470e6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:41.143895 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-95b3f5e1-d7b1-4b56-9b00-70d69c0470e6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:41.144818 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-95b3f5e1-d7b1-4b56-9b00-70d69c0470e6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:41.145392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-95b3f5e1-d7b1-4b56-9b00-70d69c0470e6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:41.236704 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-95b3f5e1-d7b1-4b56-9b00-70d69c0470e6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:41.244370 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-95b3f5e1-d7b1-4b56-9b00-70d69c0470e6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.122255 Jun 16 00:26:41.245135 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 48/84] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:41 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:41.610703 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5994f5f4-e3de-4269-a060-22e4b421e3d5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:41.611987 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5994f5f4-e3de-4269-a060-22e4b421e3d5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:41.620573 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5994f5f4-e3de-4269-a060-22e4b421e3d5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:41.621349 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5994f5f4-e3de-4269-a060-22e4b421e3d5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:41.622139 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5994f5f4-e3de-4269-a060-22e4b421e3d5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:41.622756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5994f5f4-e3de-4269-a060-22e4b421e3d5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:41.739697 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-15dc2c8a-f8fa-456a-90bd-89961caaea4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:41.740973 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-15dc2c8a-f8fa-456a-90bd-89961caaea4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:41.750396 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-15dc2c8a-f8fa-456a-90bd-89961caaea4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:41.751355 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-15dc2c8a-f8fa-456a-90bd-89961caaea4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:41.752991 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-15dc2c8a-f8fa-456a-90bd-89961caaea4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:41.753771 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-15dc2c8a-f8fa-456a-90bd-89961caaea4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:41.935020 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-15dc2c8a-f8fa-456a-90bd-89961caaea4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:41.945380 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-15dc2c8a-f8fa-456a-90bd-89961caaea4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:41.948336 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-15dc2c8a-f8fa-456a-90bd-89961caaea4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:41.949601 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-15dc2c8a-f8fa-456a-90bd-89961caaea4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1340 microversion: 2.20 time: 0.214981 Jun 16 00:26:41.950733 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 49/85] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:41 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1340 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:26:42.028104 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d95db577-501b-4758-82cf-a1ff3dd1ebff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:42.029208 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d95db577-501b-4758-82cf-a1ff3dd1ebff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:42.036158 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d95db577-501b-4758-82cf-a1ff3dd1ebff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:42.036602 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d95db577-501b-4758-82cf-a1ff3dd1ebff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:42.037611 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d95db577-501b-4758-82cf-a1ff3dd1ebff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:42.038047 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d95db577-501b-4758-82cf-a1ff3dd1ebff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:42.243172 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5994f5f4-e3de-4269-a060-22e4b421e3d5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:42.253349 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5994f5f4-e3de-4269-a060-22e4b421e3d5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.648881 Jun 16 00:26:42.254072 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 37/86] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:41 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:42.267015 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-15512a87-916b-4971-889a-559afe12a62d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:42.267660 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-15512a87-916b-4971-889a-559afe12a62d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:42.273522 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-15512a87-916b-4971-889a-559afe12a62d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:42.273972 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-15512a87-916b-4971-889a-559afe12a62d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:42.275375 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-15512a87-916b-4971-889a-559afe12a62d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:42.275854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-15512a87-916b-4971-889a-559afe12a62d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:42.384259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-15512a87-916b-4971-889a-559afe12a62d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:42.389819 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d95db577-501b-4758-82cf-a1ff3dd1ebff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:42.394301 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-15512a87-916b-4971-889a-559afe12a62d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.136667 Jun 16 00:26:42.395295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 38/87] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:42 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:42.399022 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d95db577-501b-4758-82cf-a1ff3dd1ebff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.374929 Jun 16 00:26:42.399583 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 50/88] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:42 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:42.973265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3700cee6-600c-4265-9576-21168a882fc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:42.974134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3700cee6-600c-4265-9576-21168a882fc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:42.981258 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3700cee6-600c-4265-9576-21168a882fc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:42.982217 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3700cee6-600c-4265-9576-21168a882fc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:42.983315 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3700cee6-600c-4265-9576-21168a882fc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:42.995269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3700cee6-600c-4265-9576-21168a882fc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:43.087046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3700cee6-600c-4265-9576-21168a882fc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:43.097540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3700cee6-600c-4265-9576-21168a882fc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:43.099923 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3700cee6-600c-4265-9576-21168a882fc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:43.101025 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3700cee6-600c-4265-9576-21168a882fc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1340 microversion: 2.20 time: 0.135980 Jun 16 00:26:43.112249 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 39/89] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:42 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1340 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:43.278785 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-236e8562-51ce-4866-918e-8fd72b3d0eb8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:43.280263 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-236e8562-51ce-4866-918e-8fd72b3d0eb8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:43.287566 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-236e8562-51ce-4866-918e-8fd72b3d0eb8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:43.288123 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-236e8562-51ce-4866-918e-8fd72b3d0eb8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:43.288975 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-236e8562-51ce-4866-918e-8fd72b3d0eb8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:43.289513 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-236e8562-51ce-4866-918e-8fd72b3d0eb8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:43.412646 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6653b54f-c86c-443d-86bf-7718fe0900c0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:43.413176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6653b54f-c86c-443d-86bf-7718fe0900c0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:43.421386 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6653b54f-c86c-443d-86bf-7718fe0900c0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:43.421834 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6653b54f-c86c-443d-86bf-7718fe0900c0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:43.422701 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6653b54f-c86c-443d-86bf-7718fe0900c0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:43.423194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6653b54f-c86c-443d-86bf-7718fe0900c0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:43.438620 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-236e8562-51ce-4866-918e-8fd72b3d0eb8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:43.446848 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-236e8562-51ce-4866-918e-8fd72b3d0eb8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.173661 Jun 16 00:26:43.456636 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 51/90] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:43 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:43.461349 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-30af69ee-160a-40d3-926a-a296f5589d03 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:43.461953 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-30af69ee-160a-40d3-926a-a296f5589d03 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:43.468028 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-30af69ee-160a-40d3-926a-a296f5589d03 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:43.468510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-30af69ee-160a-40d3-926a-a296f5589d03 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:43.469869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-30af69ee-160a-40d3-926a-a296f5589d03 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:43.470301 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-30af69ee-160a-40d3-926a-a296f5589d03 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:43.494595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6653b54f-c86c-443d-86bf-7718fe0900c0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:43.502804 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6653b54f-c86c-443d-86bf-7718fe0900c0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.094111 Jun 16 00:26:43.503370 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 40/91] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:43 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:43.602172 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-30af69ee-160a-40d3-926a-a296f5589d03 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:43.610593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-30af69ee-160a-40d3-926a-a296f5589d03 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.152857 Jun 16 00:26:43.611180 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 52/92] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:43 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:44.118987 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-cadcbfe6-c29f-454d-ac1a-e432e0200ab8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:44.119590 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-cadcbfe6-c29f-454d-ac1a-e432e0200ab8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:44.125814 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cadcbfe6-c29f-454d-ac1a-e432e0200ab8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:44.126261 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cadcbfe6-c29f-454d-ac1a-e432e0200ab8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:44.127068 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cadcbfe6-c29f-454d-ac1a-e432e0200ab8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:44.127507 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cadcbfe6-c29f-454d-ac1a-e432e0200ab8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:44.132480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=100 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:44.191632 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-cadcbfe6-c29f-454d-ac1a-e432e0200ab8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:44.199917 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-cadcbfe6-c29f-454d-ac1a-e432e0200ab8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:44.201589 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-cadcbfe6-c29f-454d-ac1a-e432e0200ab8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:44.202683 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-cadcbfe6-c29f-454d-ac1a-e432e0200ab8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1340 microversion: 2.20 time: 0.087473 Jun 16 00:26:44.203233 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 41/93] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:44 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:44.465321 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-633bac96-f279-4782-9891-d4d52011c59d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:44.466680 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-633bac96-f279-4782-9891-d4d52011c59d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:44.478418 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-633bac96-f279-4782-9891-d4d52011c59d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:44.479351 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-633bac96-f279-4782-9891-d4d52011c59d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:44.480240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-633bac96-f279-4782-9891-d4d52011c59d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:44.480751 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-633bac96-f279-4782-9891-d4d52011c59d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:44.521616 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d52abf5a-d91b-43cf-be3e-ff3ef857ed3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:44.522964 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d52abf5a-d91b-43cf-be3e-ff3ef857ed3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:44.534863 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d52abf5a-d91b-43cf-be3e-ff3ef857ed3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:44.539785 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d52abf5a-d91b-43cf-be3e-ff3ef857ed3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:44.543755 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d52abf5a-d91b-43cf-be3e-ff3ef857ed3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:44.544718 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d52abf5a-d91b-43cf-be3e-ff3ef857ed3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:44.673169 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-d52abf5a-d91b-43cf-be3e-ff3ef857ed3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:44.685207 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d52abf5a-d91b-43cf-be3e-ff3ef857ed3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.167128 Jun 16 00:26:44.685794 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 42/94] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:44 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:44.706833 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f59f6021-886b-4ce3-b743-57998e4614dc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:44.707460 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f59f6021-886b-4ce3-b743-57998e4614dc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:44.732258 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f59f6021-886b-4ce3-b743-57998e4614dc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:44.734439 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f59f6021-886b-4ce3-b743-57998e4614dc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:44.737052 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f59f6021-886b-4ce3-b743-57998e4614dc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:44.738315 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f59f6021-886b-4ce3-b743-57998e4614dc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:44.744207 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-633bac96-f279-4782-9891-d4d52011c59d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:44.753400 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-633bac96-f279-4782-9891-d4d52011c59d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.293134 Jun 16 00:26:44.754719 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 53/95] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:44 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:44.937862 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f59f6021-886b-4ce3-b743-57998e4614dc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:44.955276 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f59f6021-886b-4ce3-b743-57998e4614dc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.250750 Jun 16 00:26:44.955947 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 43/96] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:44 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:45.223183 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0d7de690-1e2f-4e1b-825a-dd02304d0825 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:45.226734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0d7de690-1e2f-4e1b-825a-dd02304d0825 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:45.241364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0d7de690-1e2f-4e1b-825a-dd02304d0825 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:45.241848 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0d7de690-1e2f-4e1b-825a-dd02304d0825 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:45.242667 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0d7de690-1e2f-4e1b-825a-dd02304d0825 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:45.243106 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0d7de690-1e2f-4e1b-825a-dd02304d0825 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:45.379548 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0d7de690-1e2f-4e1b-825a-dd02304d0825 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:45.389341 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0d7de690-1e2f-4e1b-825a-dd02304d0825 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:45.390920 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0d7de690-1e2f-4e1b-825a-dd02304d0825 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:45.392095 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0d7de690-1e2f-4e1b-825a-dd02304d0825 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.175065 Jun 16 00:26:45.392649 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 54/97] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:45 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:45.702836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-41f0fc5f-fbf5-4fe8-a854-4569b89a3da5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:45.704275 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-41f0fc5f-fbf5-4fe8-a854-4569b89a3da5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:45.710751 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-41f0fc5f-fbf5-4fe8-a854-4569b89a3da5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:45.711123 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-41f0fc5f-fbf5-4fe8-a854-4569b89a3da5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:45.711911 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-41f0fc5f-fbf5-4fe8-a854-4569b89a3da5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:45.712341 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-41f0fc5f-fbf5-4fe8-a854-4569b89a3da5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:45.771598 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c8f0151c-e17c-445a-a159-1443c5de49f7 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:45.772325 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c8f0151c-e17c-445a-a159-1443c5de49f7 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:45.778074 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c8f0151c-e17c-445a-a159-1443c5de49f7 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:45.778523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c8f0151c-e17c-445a-a159-1443c5de49f7 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:45.779288 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c8f0151c-e17c-445a-a159-1443c5de49f7 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:45.779767 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c8f0151c-e17c-445a-a159-1443c5de49f7 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:45.785172 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-41f0fc5f-fbf5-4fe8-a854-4569b89a3da5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:45.794331 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-41f0fc5f-fbf5-4fe8-a854-4569b89a3da5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.095963 Jun 16 00:26:45.802481 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 44/98] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:45 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:45.917511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c8f0151c-e17c-445a-a159-1443c5de49f7 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:45.925014 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c8f0151c-e17c-445a-a159-1443c5de49f7 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.158025 Jun 16 00:26:45.925575 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 55/99] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:45 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:45.972450 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-73b862cb-3d97-429e-b116-ac60b4b5f57e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:45.973060 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-73b862cb-3d97-429e-b116-ac60b4b5f57e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:45.979299 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-73b862cb-3d97-429e-b116-ac60b4b5f57e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:45.979783 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-73b862cb-3d97-429e-b116-ac60b4b5f57e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:45.980547 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-73b862cb-3d97-429e-b116-ac60b4b5f57e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:45.980977 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-73b862cb-3d97-429e-b116-ac60b4b5f57e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:46.116602 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-73b862cb-3d97-429e-b116-ac60b4b5f57e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:46.124879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-73b862cb-3d97-429e-b116-ac60b4b5f57e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.156240 Jun 16 00:26:46.126048 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 45/100] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:45 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:46.414431 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5059447a-905d-4e1b-8932-7a00cee741ed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:46.415305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5059447a-905d-4e1b-8932-7a00cee741ed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:46.421315 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5059447a-905d-4e1b-8932-7a00cee741ed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:46.422442 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5059447a-905d-4e1b-8932-7a00cee741ed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:46.423381 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5059447a-905d-4e1b-8932-7a00cee741ed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:46.423847 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5059447a-905d-4e1b-8932-7a00cee741ed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:46.439517 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=100 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:46.507468 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=4 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:46.575972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5059447a-905d-4e1b-8932-7a00cee741ed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:46.583994 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5059447a-905d-4e1b-8932-7a00cee741ed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:46.585479 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5059447a-905d-4e1b-8932-7a00cee741ed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:46.586576 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5059447a-905d-4e1b-8932-7a00cee741ed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.180861 Jun 16 00:26:46.587114 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 56/101] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:46 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:46.811245 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2a3a4a42-4eff-434f-8ed2-0b688a553d72 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:46.811904 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2a3a4a42-4eff-434f-8ed2-0b688a553d72 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:46.820982 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2a3a4a42-4eff-434f-8ed2-0b688a553d72 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:46.821434 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2a3a4a42-4eff-434f-8ed2-0b688a553d72 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:46.822376 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2a3a4a42-4eff-434f-8ed2-0b688a553d72 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:46.822978 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2a3a4a42-4eff-434f-8ed2-0b688a553d72 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:46.886553 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2a3a4a42-4eff-434f-8ed2-0b688a553d72 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:46.894284 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2a3a4a42-4eff-434f-8ed2-0b688a553d72 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.087162 Jun 16 00:26:46.895354 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 46/102] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:46 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:46.942357 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ff67522b-9a82-493e-b174-c35863a49237 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:46.942974 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ff67522b-9a82-493e-b174-c35863a49237 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:46.950148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ff67522b-9a82-493e-b174-c35863a49237 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:46.950603 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ff67522b-9a82-493e-b174-c35863a49237 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:46.951403 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ff67522b-9a82-493e-b174-c35863a49237 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:46.951870 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ff67522b-9a82-493e-b174-c35863a49237 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:47.120311 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ff67522b-9a82-493e-b174-c35863a49237 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:47.133299 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ff67522b-9a82-493e-b174-c35863a49237 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.194659 Jun 16 00:26:47.134588 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 57/103] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:46 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:47.145166 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-be7d4e44-3d0b-490e-8518-82688e16acdd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:47.145773 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-be7d4e44-3d0b-490e-8518-82688e16acdd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:47.152193 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-be7d4e44-3d0b-490e-8518-82688e16acdd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:47.152666 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-be7d4e44-3d0b-490e-8518-82688e16acdd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:47.153472 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-be7d4e44-3d0b-490e-8518-82688e16acdd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:47.153909 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-be7d4e44-3d0b-490e-8518-82688e16acdd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:47.304162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-be7d4e44-3d0b-490e-8518-82688e16acdd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:47.311700 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-be7d4e44-3d0b-490e-8518-82688e16acdd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.170905 Jun 16 00:26:47.312244 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 47/104] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:47 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:47.604297 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4fd1dc45-38a2-4a5a-891e-e4b48c1914e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:47.605003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4fd1dc45-38a2-4a5a-891e-e4b48c1914e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:47.610988 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4fd1dc45-38a2-4a5a-891e-e4b48c1914e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:47.611437 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4fd1dc45-38a2-4a5a-891e-e4b48c1914e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:47.612233 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4fd1dc45-38a2-4a5a-891e-e4b48c1914e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:47.612667 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4fd1dc45-38a2-4a5a-891e-e4b48c1914e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:47.746568 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4fd1dc45-38a2-4a5a-891e-e4b48c1914e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:47.755087 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4fd1dc45-38a2-4a5a-891e-e4b48c1914e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:47.756693 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4fd1dc45-38a2-4a5a-891e-e4b48c1914e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:47.757861 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4fd1dc45-38a2-4a5a-891e-e4b48c1914e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.157760 Jun 16 00:26:47.758514 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 58/105] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:47 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:47.910759 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-fdb4b203-1452-4151-82a3-80df3fdd98c8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:47.911365 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-fdb4b203-1452-4151-82a3-80df3fdd98c8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:47.917279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fdb4b203-1452-4151-82a3-80df3fdd98c8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:47.917715 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fdb4b203-1452-4151-82a3-80df3fdd98c8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:47.918495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fdb4b203-1452-4151-82a3-80df3fdd98c8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:47.918924 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fdb4b203-1452-4151-82a3-80df3fdd98c8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:47.980904 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fdb4b203-1452-4151-82a3-80df3fdd98c8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:47.988795 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-fdb4b203-1452-4151-82a3-80df3fdd98c8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.082532 Jun 16 00:26:47.989363 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 48/106] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:47 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:48.153336 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9fdc7a3e-e966-4b47-9e69-3e54825fc047 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:48.154019 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9fdc7a3e-e966-4b47-9e69-3e54825fc047 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:48.160045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9fdc7a3e-e966-4b47-9e69-3e54825fc047 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:48.160500 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9fdc7a3e-e966-4b47-9e69-3e54825fc047 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:48.161271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9fdc7a3e-e966-4b47-9e69-3e54825fc047 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:48.161715 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9fdc7a3e-e966-4b47-9e69-3e54825fc047 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:48.288698 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9fdc7a3e-e966-4b47-9e69-3e54825fc047 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:48.296229 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9fdc7a3e-e966-4b47-9e69-3e54825fc047 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.146897 Jun 16 00:26:48.298053 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 59/107] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:48 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:48.328646 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8338ed24-e991-41eb-81ad-f35d4706a542 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:48.329591 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8338ed24-e991-41eb-81ad-f35d4706a542 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:48.335945 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8338ed24-e991-41eb-81ad-f35d4706a542 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:48.336396 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8338ed24-e991-41eb-81ad-f35d4706a542 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:48.337473 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8338ed24-e991-41eb-81ad-f35d4706a542 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:48.338045 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8338ed24-e991-41eb-81ad-f35d4706a542 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:48.487222 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8338ed24-e991-41eb-81ad-f35d4706a542 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:48.494541 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8338ed24-e991-41eb-81ad-f35d4706a542 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.169877 Jun 16 00:26:48.495174 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 49/108] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:48 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:48.777212 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b1c4e35f-dec6-4999-92ee-b3ac739d3072 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:48.777940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b1c4e35f-dec6-4999-92ee-b3ac739d3072 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:48.784337 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b1c4e35f-dec6-4999-92ee-b3ac739d3072 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:48.784787 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b1c4e35f-dec6-4999-92ee-b3ac739d3072 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:48.785562 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b1c4e35f-dec6-4999-92ee-b3ac739d3072 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:48.785996 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b1c4e35f-dec6-4999-92ee-b3ac739d3072 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:48.925070 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b1c4e35f-dec6-4999-92ee-b3ac739d3072 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:48.935923 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b1c4e35f-dec6-4999-92ee-b3ac739d3072 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:48.938049 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b1c4e35f-dec6-4999-92ee-b3ac739d3072 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:48.939216 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b1c4e35f-dec6-4999-92ee-b3ac739d3072 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.165801 Jun 16 00:26:48.939874 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 60/109] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:48 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:49.005844 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-30a8cec5-18fb-480e-89af-987ccb2e1548 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:49.006452 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-30a8cec5-18fb-480e-89af-987ccb2e1548 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:49.008296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=4 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:49.008941 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=6 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:49.014993 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-30a8cec5-18fb-480e-89af-987ccb2e1548 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:49.015440 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-30a8cec5-18fb-480e-89af-987ccb2e1548 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:49.016251 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-30a8cec5-18fb-480e-89af-987ccb2e1548 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:49.016814 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-30a8cec5-18fb-480e-89af-987ccb2e1548 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:49.077257 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-30a8cec5-18fb-480e-89af-987ccb2e1548 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:49.084712 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-30a8cec5-18fb-480e-89af-987ccb2e1548 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.082659 Jun 16 00:26:49.085264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 50/110] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:49 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:49.314130 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3e2d9a13-9faf-4478-827a-7f0558ac7c03 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:49.314746 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-3e2d9a13-9faf-4478-827a-7f0558ac7c03 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:49.316585 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=10 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:49.321913 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3e2d9a13-9faf-4478-827a-7f0558ac7c03 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:49.322363 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3e2d9a13-9faf-4478-827a-7f0558ac7c03 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:49.323125 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3e2d9a13-9faf-4478-827a-7f0558ac7c03 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:49.323560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3e2d9a13-9faf-4478-827a-7f0558ac7c03 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:49.452473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3e2d9a13-9faf-4478-827a-7f0558ac7c03 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:49.460598 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3e2d9a13-9faf-4478-827a-7f0558ac7c03 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.150817 Jun 16 00:26:49.461159 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 61/111] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:49 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:49.510611 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f547ddc4-0053-430e-a4bb-2b24888a3307 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:49.511201 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f547ddc4-0053-430e-a4bb-2b24888a3307 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:49.517671 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f547ddc4-0053-430e-a4bb-2b24888a3307 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:49.518123 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f547ddc4-0053-430e-a4bb-2b24888a3307 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:49.518890 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f547ddc4-0053-430e-a4bb-2b24888a3307 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:49.519321 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f547ddc4-0053-430e-a4bb-2b24888a3307 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:49.645910 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f547ddc4-0053-430e-a4bb-2b24888a3307 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:49.653231 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f547ddc4-0053-430e-a4bb-2b24888a3307 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.146429 Jun 16 00:26:49.653798 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 51/112] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:49 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:49.957199 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-04efafbd-301d-42ed-8af8-3dd7cf953bf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:49.957796 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-04efafbd-301d-42ed-8af8-3dd7cf953bf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:49.963849 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-04efafbd-301d-42ed-8af8-3dd7cf953bf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:49.964286 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-04efafbd-301d-42ed-8af8-3dd7cf953bf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:49.965039 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-04efafbd-301d-42ed-8af8-3dd7cf953bf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:49.965469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-04efafbd-301d-42ed-8af8-3dd7cf953bf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:50.105469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-04efafbd-301d-42ed-8af8-3dd7cf953bf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:50.105660 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-50b64579-207e-4bf6-a8e2-e2080497477b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:50.106176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-50b64579-207e-4bf6-a8e2-e2080497477b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:50.113463 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-50b64579-207e-4bf6-a8e2-e2080497477b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:50.113855 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-50b64579-207e-4bf6-a8e2-e2080497477b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:50.114622 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-50b64579-207e-4bf6-a8e2-e2080497477b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:50.114722 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-04efafbd-301d-42ed-8af8-3dd7cf953bf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:50.115054 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-50b64579-207e-4bf6-a8e2-e2080497477b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:50.116145 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-04efafbd-301d-42ed-8af8-3dd7cf953bf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:50.117252 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-04efafbd-301d-42ed-8af8-3dd7cf953bf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.164017 Jun 16 00:26:50.122973 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 62/113] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:49 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:50.176163 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-50b64579-207e-4bf6-a8e2-e2080497477b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:50.183976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-50b64579-207e-4bf6-a8e2-e2080497477b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.082054 Jun 16 00:26:50.184564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 52/114] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:50 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:50.477216 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c3f73853-f842-452e-a50e-577d4e68304d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:50.477819 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c3f73853-f842-452e-a50e-577d4e68304d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:50.483764 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c3f73853-f842-452e-a50e-577d4e68304d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:50.484925 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c3f73853-f842-452e-a50e-577d4e68304d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:50.485680 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c3f73853-f842-452e-a50e-577d4e68304d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:50.486115 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c3f73853-f842-452e-a50e-577d4e68304d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:50.610430 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c3f73853-f842-452e-a50e-577d4e68304d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:50.617801 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c3f73853-f842-452e-a50e-577d4e68304d tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.144446 Jun 16 00:26:50.618372 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 63/115] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:50 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:50.669857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1b84df7a-b6ff-4c7b-a45f-83daadd4badc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:50.670460 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1b84df7a-b6ff-4c7b-a45f-83daadd4badc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:50.676952 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1b84df7a-b6ff-4c7b-a45f-83daadd4badc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:50.677393 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1b84df7a-b6ff-4c7b-a45f-83daadd4badc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:50.678141 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1b84df7a-b6ff-4c7b-a45f-83daadd4badc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:50.678572 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1b84df7a-b6ff-4c7b-a45f-83daadd4badc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:50.811149 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1b84df7a-b6ff-4c7b-a45f-83daadd4badc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:50.818783 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1b84df7a-b6ff-4c7b-a45f-83daadd4badc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.152647 Jun 16 00:26:50.819345 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 53/116] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:50 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:51.137249 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3a1f2259-4d1a-4a35-abc1-45d5881d18e0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:51.138292 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-3a1f2259-4d1a-4a35-abc1-45d5881d18e0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:51.147074 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3a1f2259-4d1a-4a35-abc1-45d5881d18e0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:51.147686 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3a1f2259-4d1a-4a35-abc1-45d5881d18e0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:51.148949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3a1f2259-4d1a-4a35-abc1-45d5881d18e0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:51.149469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3a1f2259-4d1a-4a35-abc1-45d5881d18e0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:51.203824 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5b23db3d-e2c3-4859-b64c-3f839ef04001 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:51.204495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5b23db3d-e2c3-4859-b64c-3f839ef04001 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:51.210971 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5b23db3d-e2c3-4859-b64c-3f839ef04001 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:51.211495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5b23db3d-e2c3-4859-b64c-3f839ef04001 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:51.212443 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5b23db3d-e2c3-4859-b64c-3f839ef04001 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:51.212948 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5b23db3d-e2c3-4859-b64c-3f839ef04001 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:51.284505 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5b23db3d-e2c3-4859-b64c-3f839ef04001 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:51.292823 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5b23db3d-e2c3-4859-b64c-3f839ef04001 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.093568 Jun 16 00:26:51.303165 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 54/117] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:51 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:51.313767 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3a1f2259-4d1a-4a35-abc1-45d5881d18e0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:51.321874 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3a1f2259-4d1a-4a35-abc1-45d5881d18e0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:51.323423 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3a1f2259-4d1a-4a35-abc1-45d5881d18e0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:51.324788 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3a1f2259-4d1a-4a35-abc1-45d5881d18e0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.191677 Jun 16 00:26:51.325443 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 64/118] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:51 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:51.634342 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-77ec8a9c-9c57-407f-8ba9-839f458da103 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:51.634946 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-77ec8a9c-9c57-407f-8ba9-839f458da103 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:51.641121 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-77ec8a9c-9c57-407f-8ba9-839f458da103 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:51.641564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-77ec8a9c-9c57-407f-8ba9-839f458da103 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:51.642316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-77ec8a9c-9c57-407f-8ba9-839f458da103 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:51.642745 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-77ec8a9c-9c57-407f-8ba9-839f458da103 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:51.769872 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-77ec8a9c-9c57-407f-8ba9-839f458da103 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:51.777258 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-77ec8a9c-9c57-407f-8ba9-839f458da103 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.146759 Jun 16 00:26:51.777816 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 55/119] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:51 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:51.835859 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4ae9ec42-fa45-4cef-8af6-2da4058628c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:51.836400 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4ae9ec42-fa45-4cef-8af6-2da4058628c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:51.842410 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4ae9ec42-fa45-4cef-8af6-2da4058628c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:51.842859 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4ae9ec42-fa45-4cef-8af6-2da4058628c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:51.843632 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4ae9ec42-fa45-4cef-8af6-2da4058628c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:51.844070 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4ae9ec42-fa45-4cef-8af6-2da4058628c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:51.967146 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4ae9ec42-fa45-4cef-8af6-2da4058628c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:51.974498 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4ae9ec42-fa45-4cef-8af6-2da4058628c4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.142570 Jun 16 00:26:51.975055 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 65/120] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:51 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:52.310246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1fd5e992-35f7-4215-b46f-45b8d4b878dd tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:52.310852 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1fd5e992-35f7-4215-b46f-45b8d4b878dd tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:52.317363 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1fd5e992-35f7-4215-b46f-45b8d4b878dd tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:52.317807 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1fd5e992-35f7-4215-b46f-45b8d4b878dd tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:52.318561 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1fd5e992-35f7-4215-b46f-45b8d4b878dd tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:52.318991 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1fd5e992-35f7-4215-b46f-45b8d4b878dd tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:52.343296 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b14f0abf-973a-4ff5-919c-4a49391fc1f0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:52.343970 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b14f0abf-973a-4ff5-919c-4a49391fc1f0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:52.350018 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b14f0abf-973a-4ff5-919c-4a49391fc1f0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:52.350462 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b14f0abf-973a-4ff5-919c-4a49391fc1f0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:52.351218 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b14f0abf-973a-4ff5-919c-4a49391fc1f0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:52.351675 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b14f0abf-973a-4ff5-919c-4a49391fc1f0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:52.378765 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1fd5e992-35f7-4215-b46f-45b8d4b878dd tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:52.386215 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1fd5e992-35f7-4215-b46f-45b8d4b878dd tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.079758 Jun 16 00:26:52.386909 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 56/121] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:52 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:52.478629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b14f0abf-973a-4ff5-919c-4a49391fc1f0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:52.487157 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b14f0abf-973a-4ff5-919c-4a49391fc1f0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:52.488675 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b14f0abf-973a-4ff5-919c-4a49391fc1f0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:52.489874 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b14f0abf-973a-4ff5-919c-4a49391fc1f0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.150479 Jun 16 00:26:52.490575 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 66/122] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:52 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:26:52.793845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-35894608-c1d2-4c73-9565-c5e28fa27508 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:52.794443 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-35894608-c1d2-4c73-9565-c5e28fa27508 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:52.801064 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-35894608-c1d2-4c73-9565-c5e28fa27508 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:52.801506 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-35894608-c1d2-4c73-9565-c5e28fa27508 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:52.802258 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-35894608-c1d2-4c73-9565-c5e28fa27508 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:52.803013 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-35894608-c1d2-4c73-9565-c5e28fa27508 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:52.929657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-35894608-c1d2-4c73-9565-c5e28fa27508 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:52.933078 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=100 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:52.937827 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-35894608-c1d2-4c73-9565-c5e28fa27508 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.147803 Jun 16 00:26:52.938394 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 57/123] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:52 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:52.990889 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-be92f821-2954-4e93-a4a3-06b26a535ed7 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:52.991501 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-be92f821-2954-4e93-a4a3-06b26a535ed7 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:52.997515 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-be92f821-2954-4e93-a4a3-06b26a535ed7 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:52.998147 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-be92f821-2954-4e93-a4a3-06b26a535ed7 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:52.998904 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-be92f821-2954-4e93-a4a3-06b26a535ed7 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:52.999341 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-be92f821-2954-4e93-a4a3-06b26a535ed7 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:53.124019 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-be92f821-2954-4e93-a4a3-06b26a535ed7 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:53.131338 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-be92f821-2954-4e93-a4a3-06b26a535ed7 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.144205 Jun 16 00:26:53.131948 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 67/124] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:52 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:53.402151 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ac7f2e3e-d9e2-4436-8c53-f2a34e56e0db tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:53.402764 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ac7f2e3e-d9e2-4436-8c53-f2a34e56e0db tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:53.409504 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ac7f2e3e-d9e2-4436-8c53-f2a34e56e0db tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:53.409956 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ac7f2e3e-d9e2-4436-8c53-f2a34e56e0db tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:53.410720 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ac7f2e3e-d9e2-4436-8c53-f2a34e56e0db tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:53.411161 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ac7f2e3e-d9e2-4436-8c53-f2a34e56e0db tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:53.487889 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ac7f2e3e-d9e2-4436-8c53-f2a34e56e0db tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:53.497089 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ac7f2e3e-d9e2-4436-8c53-f2a34e56e0db tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1245 microversion: 2.1 time: 0.098797 Jun 16 00:26:53.499317 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 58/125] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:53 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:53.516569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-08eb964c-6faa-4d5f-a742-39e5716206c7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:53.517183 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-08eb964c-6faa-4d5f-a742-39e5716206c7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:53.523990 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-08eb964c-6faa-4d5f-a742-39e5716206c7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:53.524612 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-08eb964c-6faa-4d5f-a742-39e5716206c7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:53.525439 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-08eb964c-6faa-4d5f-a742-39e5716206c7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:53.526049 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-08eb964c-6faa-4d5f-a742-39e5716206c7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:53.671453 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-08eb964c-6faa-4d5f-a742-39e5716206c7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:53.680635 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-08eb964c-6faa-4d5f-a742-39e5716206c7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:53.682257 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-08eb964c-6faa-4d5f-a742-39e5716206c7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:53.683364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-08eb964c-6faa-4d5f-a742-39e5716206c7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.173181 Jun 16 00:26:53.691667 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 68/126] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:53 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:53.954866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4250de18-808d-42b7-ac7e-597b84dd4837 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:53.955506 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4250de18-808d-42b7-ac7e-597b84dd4837 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:53.961780 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4250de18-808d-42b7-ac7e-597b84dd4837 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:53.962171 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4250de18-808d-42b7-ac7e-597b84dd4837 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:53.962940 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4250de18-808d-42b7-ac7e-597b84dd4837 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:53.963382 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4250de18-808d-42b7-ac7e-597b84dd4837 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:54.088530 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4250de18-808d-42b7-ac7e-597b84dd4837 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:54.096471 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4250de18-808d-42b7-ac7e-597b84dd4837 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.145957 Jun 16 00:26:54.097036 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 59/127] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:53 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:54.149661 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-41523a2b-cdec-4e1b-90c3-f49b250b0d5e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:54.150266 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-41523a2b-cdec-4e1b-90c3-f49b250b0d5e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:54.156842 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-41523a2b-cdec-4e1b-90c3-f49b250b0d5e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:54.157378 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-41523a2b-cdec-4e1b-90c3-f49b250b0d5e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:54.158275 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-41523a2b-cdec-4e1b-90c3-f49b250b0d5e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:54.159060 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-41523a2b-cdec-4e1b-90c3-f49b250b0d5e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:54.339169 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-41523a2b-cdec-4e1b-90c3-f49b250b0d5e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:54.349668 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-41523a2b-cdec-4e1b-90c3-f49b250b0d5e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.203755 Jun 16 00:26:54.360587 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 69/128] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:54 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:54.361200 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-5a33b8e0-8e5c-4e7b-878a-2d3c29ad63b0 req-d40b1820-5cbf-4849-ad61-30bda7d31e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b84afb6-466c-477a-9339-b4a0ecef36be", "tag": "f807a98a-f8e6-4868-ab21-4008a07a1ae4"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:54.369365 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-5a33b8e0-8e5c-4e7b-878a-2d3c29ad63b0 req-d40b1820-5cbf-4849-ad61-30bda7d31e99 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:54.369837 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-5a33b8e0-8e5c-4e7b-878a-2d3c29ad63b0 req-d40b1820-5cbf-4849-ad61-30bda7d31e99 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:54.381587 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-5a33b8e0-8e5c-4e7b-878a-2d3c29ad63b0 req-d40b1820-5cbf-4849-ad61-30bda7d31e99 service nova] Creating event network-changed:f807a98a-f8e6-4868-ab21-4008a07a1ae4 for instance 7b84afb6-466c-477a-9339-b4a0ecef36be on hv-cinder-84327 Jun 16 00:26:54.386538 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-5a33b8e0-8e5c-4e7b-878a-2d3c29ad63b0 req-d40b1820-5cbf-4849-ad61-30bda7d31e99 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029695 Jun 16 00:26:54.387167 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 60/129] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:26:54.515057 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-925e6264-4e15-470d-9d64-be53c2c55952 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:54.515879 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-925e6264-4e15-470d-9d64-be53c2c55952 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:54.522756 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-925e6264-4e15-470d-9d64-be53c2c55952 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:54.523210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-925e6264-4e15-470d-9d64-be53c2c55952 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:54.524025 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-925e6264-4e15-470d-9d64-be53c2c55952 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:54.524461 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-925e6264-4e15-470d-9d64-be53c2c55952 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:54.587845 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-925e6264-4e15-470d-9d64-be53c2c55952 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:54.595761 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-925e6264-4e15-470d-9d64-be53c2c55952 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1237 microversion: 2.1 time: 0.085296 Jun 16 00:26:54.596310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 70/130] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:54 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:54.702387 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c337accb-ddf6-4817-9e4b-2c1cf8543214 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:54.703603 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c337accb-ddf6-4817-9e4b-2c1cf8543214 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:54.709740 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c337accb-ddf6-4817-9e4b-2c1cf8543214 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:54.710198 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c337accb-ddf6-4817-9e4b-2c1cf8543214 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:54.710978 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c337accb-ddf6-4817-9e4b-2c1cf8543214 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:54.711413 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c337accb-ddf6-4817-9e4b-2c1cf8543214 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:54.886346 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c337accb-ddf6-4817-9e4b-2c1cf8543214 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:54.896488 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c337accb-ddf6-4817-9e4b-2c1cf8543214 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:54.898664 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c337accb-ddf6-4817-9e4b-2c1cf8543214 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:54.900058 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c337accb-ddf6-4817-9e4b-2c1cf8543214 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.201848 Jun 16 00:26:54.901236 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 61/131] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:54 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:55.113793 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0d19a821-6468-42ec-bf5e-1cd67538dbf8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:55.114602 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0d19a821-6468-42ec-bf5e-1cd67538dbf8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:55.121589 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0d19a821-6468-42ec-bf5e-1cd67538dbf8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:55.122195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0d19a821-6468-42ec-bf5e-1cd67538dbf8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:55.123109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0d19a821-6468-42ec-bf5e-1cd67538dbf8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:55.123727 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0d19a821-6468-42ec-bf5e-1cd67538dbf8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:55.265007 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0d19a821-6468-42ec-bf5e-1cd67538dbf8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:55.273004 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0d19a821-6468-42ec-bf5e-1cd67538dbf8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.163610 Jun 16 00:26:55.273595 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 71/132] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:55 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:55.367927 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-672a95fb-a4c6-430f-92f8-2bd3fc2d0737 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:55.368465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-672a95fb-a4c6-430f-92f8-2bd3fc2d0737 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:55.374421 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-672a95fb-a4c6-430f-92f8-2bd3fc2d0737 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:55.374888 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-672a95fb-a4c6-430f-92f8-2bd3fc2d0737 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:55.375663 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-672a95fb-a4c6-430f-92f8-2bd3fc2d0737 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:55.376104 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-672a95fb-a4c6-430f-92f8-2bd3fc2d0737 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:55.500987 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-672a95fb-a4c6-430f-92f8-2bd3fc2d0737 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:55.508376 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-672a95fb-a4c6-430f-92f8-2bd3fc2d0737 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.144388 Jun 16 00:26:55.508942 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 62/133] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:55 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:55.612718 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a5d3b770-f2e6-45f3-a39a-02468c2aad2b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:55.613054 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a5d3b770-f2e6-45f3-a39a-02468c2aad2b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:55.619442 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a5d3b770-f2e6-45f3-a39a-02468c2aad2b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:55.619836 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a5d3b770-f2e6-45f3-a39a-02468c2aad2b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:55.620563 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a5d3b770-f2e6-45f3-a39a-02468c2aad2b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:55.621010 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a5d3b770-f2e6-45f3-a39a-02468c2aad2b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:55.682334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a5d3b770-f2e6-45f3-a39a-02468c2aad2b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:55.689670 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a5d3b770-f2e6-45f3-a39a-02468c2aad2b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1293 microversion: 2.1 time: 0.080986 Jun 16 00:26:55.690492 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 72/134] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:55 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:55.918658 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a4dd493c-d9ac-41ac-a1b8-3c729b7cbec4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:55.919262 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a4dd493c-d9ac-41ac-a1b8-3c729b7cbec4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:55.925479 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a4dd493c-d9ac-41ac-a1b8-3c729b7cbec4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:55.925933 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a4dd493c-d9ac-41ac-a1b8-3c729b7cbec4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:55.926699 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a4dd493c-d9ac-41ac-a1b8-3c729b7cbec4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:55.927141 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a4dd493c-d9ac-41ac-a1b8-3c729b7cbec4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:56.267473 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a4dd493c-d9ac-41ac-a1b8-3c729b7cbec4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:56.279141 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a4dd493c-d9ac-41ac-a1b8-3c729b7cbec4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:56.284938 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a4dd493c-d9ac-41ac-a1b8-3c729b7cbec4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:56.287401 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a4dd493c-d9ac-41ac-a1b8-3c729b7cbec4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.372544 Jun 16 00:26:56.288201 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 63/135] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:55 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:56.292950 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b79ea861-472f-4152-8c47-5b7e65d821e5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:56.293772 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b79ea861-472f-4152-8c47-5b7e65d821e5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:56.305987 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b79ea861-472f-4152-8c47-5b7e65d821e5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:56.306654 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b79ea861-472f-4152-8c47-5b7e65d821e5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:56.307788 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b79ea861-472f-4152-8c47-5b7e65d821e5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:56.308416 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b79ea861-472f-4152-8c47-5b7e65d821e5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:56.308529 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-549fbba1-fb7b-4eaa-abf2-c881cff84ce0 req-ed5702fd-a49b-4e60-a3ce-be4cf72dd425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4", "name": "network-vif-plugged", "status": "completed", "tag": "bd914ca3-f036-4016-bdf2-f6dffc6a5655"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:56.331853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-549fbba1-fb7b-4eaa-abf2-c881cff84ce0 req-ed5702fd-a49b-4e60-a3ce-be4cf72dd425 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:56.332228 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-549fbba1-fb7b-4eaa-abf2-c881cff84ce0 req-ed5702fd-a49b-4e60-a3ce-be4cf72dd425 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:56.349458 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=100 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:56.385149 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-549fbba1-fb7b-4eaa-abf2-c881cff84ce0 req-ed5702fd-a49b-4e60-a3ce-be4cf72dd425 service nova] Creating event network-vif-plugged:bd914ca3-f036-4016-bdf2-f6dffc6a5655 for instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 on hv-cinder-84327 Jun 16 00:26:56.401954 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-549fbba1-fb7b-4eaa-abf2-c881cff84ce0 req-ed5702fd-a49b-4e60-a3ce-be4cf72dd425 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203870 Jun 16 00:26:56.402790 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 73/136] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:26:56.526102 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cd7b2bc8-49c6-42b9-b6ac-fd8e355fb1c6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:56.527138 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-cd7b2bc8-49c6-42b9-b6ac-fd8e355fb1c6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:56.540914 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cd7b2bc8-49c6-42b9-b6ac-fd8e355fb1c6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:56.541648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cd7b2bc8-49c6-42b9-b6ac-fd8e355fb1c6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:56.544146 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cd7b2bc8-49c6-42b9-b6ac-fd8e355fb1c6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:56.544793 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cd7b2bc8-49c6-42b9-b6ac-fd8e355fb1c6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:56.577342 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b79ea861-472f-4152-8c47-5b7e65d821e5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:56.591029 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b79ea861-472f-4152-8c47-5b7e65d821e5 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.301566 Jun 16 00:26:56.601345 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 64/137] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:56 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:56.708021 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e1c03f94-4008-4dd6-8982-2226e47a2bd9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:56.709014 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e1c03f94-4008-4dd6-8982-2226e47a2bd9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:56.716773 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e1c03f94-4008-4dd6-8982-2226e47a2bd9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:56.717559 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e1c03f94-4008-4dd6-8982-2226e47a2bd9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:56.719096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e1c03f94-4008-4dd6-8982-2226e47a2bd9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:56.720063 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e1c03f94-4008-4dd6-8982-2226e47a2bd9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:56.806007 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-cd7b2bc8-49c6-42b9-b6ac-fd8e355fb1c6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:56.816998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-cd7b2bc8-49c6-42b9-b6ac-fd8e355fb1c6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.295351 Jun 16 00:26:56.817565 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 74/138] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:56 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:56.871016 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e1c03f94-4008-4dd6-8982-2226e47a2bd9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:56.884564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e1c03f94-4008-4dd6-8982-2226e47a2bd9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1299 microversion: 2.1 time: 0.181652 Jun 16 00:26:56.885172 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 65/139] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:56 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1299 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:57.360295 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0dc07a74-bef8-404d-b264-848b2b0cd627 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:57.361097 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0dc07a74-bef8-404d-b264-848b2b0cd627 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:57.388566 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0dc07a74-bef8-404d-b264-848b2b0cd627 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:57.389094 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0dc07a74-bef8-404d-b264-848b2b0cd627 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:57.397747 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0dc07a74-bef8-404d-b264-848b2b0cd627 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:57.398688 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0dc07a74-bef8-404d-b264-848b2b0cd627 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:57.609087 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2ce7edb5-9035-497d-b9f9-788d0b3e2df8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:57.610442 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2ce7edb5-9035-497d-b9f9-788d0b3e2df8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:57.615148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0dc07a74-bef8-404d-b264-848b2b0cd627 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:57.619539 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2ce7edb5-9035-497d-b9f9-788d0b3e2df8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:57.620605 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2ce7edb5-9035-497d-b9f9-788d0b3e2df8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:57.623644 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2ce7edb5-9035-497d-b9f9-788d0b3e2df8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:57.624612 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2ce7edb5-9035-497d-b9f9-788d0b3e2df8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:57.625352 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0dc07a74-bef8-404d-b264-848b2b0cd627 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:57.627774 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0dc07a74-bef8-404d-b264-848b2b0cd627 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:57.629489 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0dc07a74-bef8-404d-b264-848b2b0cd627 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.310898 Jun 16 00:26:57.640745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 75/140] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:57 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:57.785984 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2ce7edb5-9035-497d-b9f9-788d0b3e2df8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:57.797911 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2ce7edb5-9035-497d-b9f9-788d0b3e2df8 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.193189 Jun 16 00:26:57.808152 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 66/141] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:57 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:57.834246 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-09a28c78-ccac-4555-ab9c-c3af58442443 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:57.835506 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-09a28c78-ccac-4555-ab9c-c3af58442443 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:57.841613 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-09a28c78-ccac-4555-ab9c-c3af58442443 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:57.842144 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-09a28c78-ccac-4555-ab9c-c3af58442443 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:57.843062 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-09a28c78-ccac-4555-ab9c-c3af58442443 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:57.843553 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-09a28c78-ccac-4555-ab9c-c3af58442443 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:57.903127 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-22a00773-8936-46b0-98ba-3151a7e5b5dc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:57.903810 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-22a00773-8936-46b0-98ba-3151a7e5b5dc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:57.910718 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-22a00773-8936-46b0-98ba-3151a7e5b5dc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:57.911844 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-22a00773-8936-46b0-98ba-3151a7e5b5dc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:57.913235 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-22a00773-8936-46b0-98ba-3151a7e5b5dc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:57.914089 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-22a00773-8936-46b0-98ba-3151a7e5b5dc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:57.998082 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-22a00773-8936-46b0-98ba-3151a7e5b5dc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:58.011592 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-22a00773-8936-46b0-98ba-3151a7e5b5dc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1299 microversion: 2.1 time: 0.113015 Jun 16 00:26:58.021329 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 67/142] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:57 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:26:58.035330 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-09a28c78-ccac-4555-ab9c-c3af58442443 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:58.045711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-09a28c78-ccac-4555-ab9c-c3af58442443 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.215534 Jun 16 00:26:58.046927 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 76/143] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:57 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:58.420564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-5989b754-3d08-423c-aeaf-bbff9cc9d575 req-907c1fd5-34e4-426e-bb5a-e3d5452ed77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8388df29-a591-4d4c-a77f-530d3f0e4693", "name": "network-vif-plugged", "status": "completed", "tag": "d9340f41-2f9e-42a9-aa33-4159ff99dd6b"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:58.429360 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-5989b754-3d08-423c-aeaf-bbff9cc9d575 req-907c1fd5-34e4-426e-bb5a-e3d5452ed77d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:58.429796 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-5989b754-3d08-423c-aeaf-bbff9cc9d575 req-907c1fd5-34e4-426e-bb5a-e3d5452ed77d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:58.441628 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-5989b754-3d08-423c-aeaf-bbff9cc9d575 req-907c1fd5-34e4-426e-bb5a-e3d5452ed77d service nova] Creating event network-vif-plugged:d9340f41-2f9e-42a9-aa33-4159ff99dd6b for instance 8388df29-a591-4d4c-a77f-530d3f0e4693 on hv-cinder-84327 Jun 16 00:26:58.446603 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-5989b754-3d08-423c-aeaf-bbff9cc9d575 req-907c1fd5-34e4-426e-bb5a-e3d5452ed77d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029746 Jun 16 00:26:58.447164 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 68/144] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:58.648623 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-47438e74-7c40-4dff-b6e3-a0ffe5691f2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:58.649220 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-47438e74-7c40-4dff-b6e3-a0ffe5691f2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:58.655388 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-47438e74-7c40-4dff-b6e3-a0ffe5691f2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:58.655870 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-47438e74-7c40-4dff-b6e3-a0ffe5691f2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:58.656636 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-47438e74-7c40-4dff-b6e3-a0ffe5691f2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:58.657073 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-47438e74-7c40-4dff-b6e3-a0ffe5691f2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:58.784167 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-47438e74-7c40-4dff-b6e3-a0ffe5691f2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:58.792041 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-47438e74-7c40-4dff-b6e3-a0ffe5691f2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:58.793530 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-47438e74-7c40-4dff-b6e3-a0ffe5691f2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:58.794763 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-47438e74-7c40-4dff-b6e3-a0ffe5691f2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.149869 Jun 16 00:26:58.795339 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 77/145] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:58 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:26:58.815739 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-cfa06ef6-0db6-49a0-8947-c3a5815382cc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:58.816591 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-cfa06ef6-0db6-49a0-8947-c3a5815382cc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:58.822743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cfa06ef6-0db6-49a0-8947-c3a5815382cc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:58.823198 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cfa06ef6-0db6-49a0-8947-c3a5815382cc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:58.823993 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cfa06ef6-0db6-49a0-8947-c3a5815382cc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:58.824434 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cfa06ef6-0db6-49a0-8947-c3a5815382cc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:58.956138 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-cfa06ef6-0db6-49a0-8947-c3a5815382cc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:58.963664 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-cfa06ef6-0db6-49a0-8947-c3a5815382cc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.152106 Jun 16 00:26:58.964437 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 69/146] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:58 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:59.030558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-202ec651-24c9-4fe3-8cda-32aec9cd6f4f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:59.031237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-202ec651-24c9-4fe3-8cda-32aec9cd6f4f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:59.034652 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:59.039736 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-202ec651-24c9-4fe3-8cda-32aec9cd6f4f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:59.040395 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-202ec651-24c9-4fe3-8cda-32aec9cd6f4f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:59.041168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-202ec651-24c9-4fe3-8cda-32aec9cd6f4f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:59.041596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-202ec651-24c9-4fe3-8cda-32aec9cd6f4f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:59.065641 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c4c015ec-f555-44d9-97c0-35972febf340 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:59.066298 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c4c015ec-f555-44d9-97c0-35972febf340 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:59.076539 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c4c015ec-f555-44d9-97c0-35972febf340 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:59.077264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c4c015ec-f555-44d9-97c0-35972febf340 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:59.079176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c4c015ec-f555-44d9-97c0-35972febf340 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:59.079885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c4c015ec-f555-44d9-97c0-35972febf340 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:59.256848 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-202ec651-24c9-4fe3-8cda-32aec9cd6f4f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:59.268795 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-202ec651-24c9-4fe3-8cda-32aec9cd6f4f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.243685 Jun 16 00:26:59.270054 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 78/147] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:59 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:59.298935 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c4c015ec-f555-44d9-97c0-35972febf340 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:26:59.307985 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c4c015ec-f555-44d9-97c0-35972febf340 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.247643 Jun 16 00:26:59.308560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 70/148] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:59 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:26:59.532010 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-a35ed81b-a54e-4537-88b0-129fc5d39be7 req-97beb2e0-4e41-401a-acd8-f31ad475b83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0940a4aa-71c4-4a96-8106-40dd8b012547", "tag": "24633b83-4728-4103-8fab-2eb65a801405"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:26:59.544640 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-a35ed81b-a54e-4537-88b0-129fc5d39be7 req-97beb2e0-4e41-401a-acd8-f31ad475b83a service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:59.545327 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-a35ed81b-a54e-4537-88b0-129fc5d39be7 req-97beb2e0-4e41-401a-acd8-f31ad475b83a service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:59.567209 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-a35ed81b-a54e-4537-88b0-129fc5d39be7 req-97beb2e0-4e41-401a-acd8-f31ad475b83a service nova] Creating event network-changed:24633b83-4728-4103-8fab-2eb65a801405 for instance 0940a4aa-71c4-4a96-8106-40dd8b012547 on hv-cinder-84327 Jun 16 00:26:59.574877 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-a35ed81b-a54e-4537-88b0-129fc5d39be7 req-97beb2e0-4e41-401a-acd8-f31ad475b83a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046132 Jun 16 00:26:59.576195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 79/149] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:59.813630 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8cc4822a-87e3-418f-8159-963d7ad96df2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:59.814488 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8cc4822a-87e3-418f-8159-963d7ad96df2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:59.826523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8cc4822a-87e3-418f-8159-963d7ad96df2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:59.828289 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8cc4822a-87e3-418f-8159-963d7ad96df2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:59.829467 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8cc4822a-87e3-418f-8159-963d7ad96df2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:59.830138 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8cc4822a-87e3-418f-8159-963d7ad96df2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:59.983178 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-983c7969-97fc-43f2-8d24-cfe104fdb7b9 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:59.984506 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-983c7969-97fc-43f2-8d24-cfe104fdb7b9 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:26:59.991934 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-983c7969-97fc-43f2-8d24-cfe104fdb7b9 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:59.992382 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-983c7969-97fc-43f2-8d24-cfe104fdb7b9 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:59.993150 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-983c7969-97fc-43f2-8d24-cfe104fdb7b9 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:59.993580 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-983c7969-97fc-43f2-8d24-cfe104fdb7b9 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:00.031127 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8cc4822a-87e3-418f-8159-963d7ad96df2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:00.040060 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8cc4822a-87e3-418f-8159-963d7ad96df2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:00.041622 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8cc4822a-87e3-418f-8159-963d7ad96df2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:00.042736 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8cc4822a-87e3-418f-8159-963d7ad96df2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.233591 Jun 16 00:27:00.043355 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 71/150] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:26:59 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:00.134589 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-983c7969-97fc-43f2-8d24-cfe104fdb7b9 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:00.142736 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-983c7969-97fc-43f2-8d24-cfe104fdb7b9 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.165758 Jun 16 00:27:00.143293 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 80/151] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:26:59 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:00.286342 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9519137c-3b65-47ef-9df1-4e118753727b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:00.286947 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9519137c-3b65-47ef-9df1-4e118753727b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:00.288975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:00.294111 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9519137c-3b65-47ef-9df1-4e118753727b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:00.294565 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9519137c-3b65-47ef-9df1-4e118753727b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:00.295332 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9519137c-3b65-47ef-9df1-4e118753727b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:00.295795 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9519137c-3b65-47ef-9df1-4e118753727b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:00.326075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-be2f07e6-f1b4-4ce8-8247-cfbcf96cb434 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:00.326583 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-be2f07e6-f1b4-4ce8-8247-cfbcf96cb434 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:00.333104 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-be2f07e6-f1b4-4ce8-8247-cfbcf96cb434 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:00.333550 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-be2f07e6-f1b4-4ce8-8247-cfbcf96cb434 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:00.334340 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-be2f07e6-f1b4-4ce8-8247-cfbcf96cb434 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:00.334774 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-be2f07e6-f1b4-4ce8-8247-cfbcf96cb434 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:00.481242 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9519137c-3b65-47ef-9df1-4e118753727b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:00.488966 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9519137c-3b65-47ef-9df1-4e118753727b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.206445 Jun 16 00:27:00.489527 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 72/152] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:00 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:00.494020 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-f4ac923e-8fed-440d-9940-7eec77fa076b req-af123f5f-0c7e-417e-acf1-37664d243c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3", "name": "network-vif-plugged", "status": "completed", "tag": "832d8e05-6171-438e-bdb8-0ab9ae6c2efe"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:00.502575 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-f4ac923e-8fed-440d-9940-7eec77fa076b req-af123f5f-0c7e-417e-acf1-37664d243c41 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:00.503008 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-f4ac923e-8fed-440d-9940-7eec77fa076b req-af123f5f-0c7e-417e-acf1-37664d243c41 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:00.513994 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-be2f07e6-f1b4-4ce8-8247-cfbcf96cb434 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:00.514137 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-f4ac923e-8fed-440d-9940-7eec77fa076b req-af123f5f-0c7e-417e-acf1-37664d243c41 service nova] Creating event network-vif-plugged:832d8e05-6171-438e-bdb8-0ab9ae6c2efe for instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 on hv-cinder-84327 Jun 16 00:27:00.519416 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-f4ac923e-8fed-440d-9940-7eec77fa076b req-af123f5f-0c7e-417e-acf1-37664d243c41 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028647 Jun 16 00:27:00.520241 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 73/153] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:00.522720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-be2f07e6-f1b4-4ce8-8247-cfbcf96cb434 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.200921 Jun 16 00:27:00.523224 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 81/154] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:00 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:01.063227 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bc6c1d26-c8a6-4651-b582-eb45b93f6cf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:01.064495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bc6c1d26-c8a6-4651-b582-eb45b93f6cf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:01.070737 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bc6c1d26-c8a6-4651-b582-eb45b93f6cf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:01.071308 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bc6c1d26-c8a6-4651-b582-eb45b93f6cf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:01.072285 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bc6c1d26-c8a6-4651-b582-eb45b93f6cf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:01.072738 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bc6c1d26-c8a6-4651-b582-eb45b93f6cf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:01.159178 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5ff37c25-c263-4457-95b8-b2b9b0fcfdfa tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:01.159813 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5ff37c25-c263-4457-95b8-b2b9b0fcfdfa tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:01.165957 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5ff37c25-c263-4457-95b8-b2b9b0fcfdfa tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:01.166385 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5ff37c25-c263-4457-95b8-b2b9b0fcfdfa tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:01.167349 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5ff37c25-c263-4457-95b8-b2b9b0fcfdfa tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:01.167989 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5ff37c25-c263-4457-95b8-b2b9b0fcfdfa tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:01.296933 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bc6c1d26-c8a6-4651-b582-eb45b93f6cf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:01.310350 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bc6c1d26-c8a6-4651-b582-eb45b93f6cf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:01.312442 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bc6c1d26-c8a6-4651-b582-eb45b93f6cf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:01.313609 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bc6c1d26-c8a6-4651-b582-eb45b93f6cf1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.255248 Jun 16 00:27:01.325779 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 74/155] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:01 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:01.357765 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5ff37c25-c263-4457-95b8-b2b9b0fcfdfa tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:01.365812 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5ff37c25-c263-4457-95b8-b2b9b0fcfdfa tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.210423 Jun 16 00:27:01.366364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 82/156] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:01 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:01.507200 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b841c9c1-7204-42f6-9862-e712aa607219 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:01.507859 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b841c9c1-7204-42f6-9862-e712aa607219 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:01.515679 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b841c9c1-7204-42f6-9862-e712aa607219 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:01.515679 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b841c9c1-7204-42f6-9862-e712aa607219 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:01.520678 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b841c9c1-7204-42f6-9862-e712aa607219 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:01.521207 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b841c9c1-7204-42f6-9862-e712aa607219 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:01.539911 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-299ee371-08dd-46b4-8db3-ad22fd12a213 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:01.540571 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-299ee371-08dd-46b4-8db3-ad22fd12a213 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:01.548120 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-299ee371-08dd-46b4-8db3-ad22fd12a213 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:01.548590 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-299ee371-08dd-46b4-8db3-ad22fd12a213 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:01.549365 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-299ee371-08dd-46b4-8db3-ad22fd12a213 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:01.549962 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-299ee371-08dd-46b4-8db3-ad22fd12a213 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:01.737429 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b841c9c1-7204-42f6-9862-e712aa607219 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:01.741293 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-299ee371-08dd-46b4-8db3-ad22fd12a213 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:01.745143 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b841c9c1-7204-42f6-9862-e712aa607219 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.242035 Jun 16 00:27:01.745848 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 75/157] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:01 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:01.750583 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-299ee371-08dd-46b4-8db3-ad22fd12a213 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.214790 Jun 16 00:27:01.751906 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 83/158] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:01 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:02.334218 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8e88d24c-c201-4236-a055-83acb9d5e36b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:02.335057 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8e88d24c-c201-4236-a055-83acb9d5e36b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:02.344908 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8e88d24c-c201-4236-a055-83acb9d5e36b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:02.345362 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8e88d24c-c201-4236-a055-83acb9d5e36b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:02.346146 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8e88d24c-c201-4236-a055-83acb9d5e36b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:02.349022 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8e88d24c-c201-4236-a055-83acb9d5e36b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:02.382969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-afc846dd-e8f8-42ce-abfe-c9d4e2386ff1 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:02.383894 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-afc846dd-e8f8-42ce-abfe-c9d4e2386ff1 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:02.397297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=100 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:02.418075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-afc846dd-e8f8-42ce-abfe-c9d4e2386ff1 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:02.418716 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-afc846dd-e8f8-42ce-abfe-c9d4e2386ff1 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:02.419628 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-afc846dd-e8f8-42ce-abfe-c9d4e2386ff1 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:02.420138 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-afc846dd-e8f8-42ce-abfe-c9d4e2386ff1 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:02.646502 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8e88d24c-c201-4236-a055-83acb9d5e36b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:02.650302 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-afc846dd-e8f8-42ce-abfe-c9d4e2386ff1 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:02.654623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8e88d24c-c201-4236-a055-83acb9d5e36b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:02.656742 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8e88d24c-c201-4236-a055-83acb9d5e36b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:02.657849 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8e88d24c-c201-4236-a055-83acb9d5e36b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.329029 Jun 16 00:27:02.658421 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 76/159] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:02 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:02.658676 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-afc846dd-e8f8-42ce-abfe-c9d4e2386ff1 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.280339 Jun 16 00:27:02.659346 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 84/160] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:02 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:02.762759 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-176e2082-9ea5-48c7-b581-1d1ef42d3fe2 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:02.763505 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-176e2082-9ea5-48c7-b581-1d1ef42d3fe2 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:02.767334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2d2d8638-164f-4309-af92-95ea9522dcef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:02.768101 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2d2d8638-164f-4309-af92-95ea9522dcef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:02.769777 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-176e2082-9ea5-48c7-b581-1d1ef42d3fe2 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:02.770229 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-176e2082-9ea5-48c7-b581-1d1ef42d3fe2 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:02.770996 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-176e2082-9ea5-48c7-b581-1d1ef42d3fe2 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:02.771428 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-176e2082-9ea5-48c7-b581-1d1ef42d3fe2 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:02.773949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2d2d8638-164f-4309-af92-95ea9522dcef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:02.774392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2d2d8638-164f-4309-af92-95ea9522dcef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:02.775183 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2d2d8638-164f-4309-af92-95ea9522dcef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:02.775779 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2d2d8638-164f-4309-af92-95ea9522dcef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:03.076716 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2d2d8638-164f-4309-af92-95ea9522dcef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:03.080145 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-176e2082-9ea5-48c7-b581-1d1ef42d3fe2 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:03.084764 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2d2d8638-164f-4309-af92-95ea9522dcef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.322057 Jun 16 00:27:03.085547 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 85/161] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:02 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:03.088060 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-176e2082-9ea5-48c7-b581-1d1ef42d3fe2 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.329288 Jun 16 00:27:03.088766 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 77/162] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:02 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:03.677072 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-53ff1102-dee2-4e95-955d-4866363a291c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:03.677816 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-53ff1102-dee2-4e95-955d-4866363a291c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:03.681683 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-739d97e3-6162-4b72-874b-a2a856e02288 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:03.682297 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-739d97e3-6162-4b72-874b-a2a856e02288 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:03.688299 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-53ff1102-dee2-4e95-955d-4866363a291c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:03.690133 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-53ff1102-dee2-4e95-955d-4866363a291c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:03.692375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-739d97e3-6162-4b72-874b-a2a856e02288 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:03.693018 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-53ff1102-dee2-4e95-955d-4866363a291c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:03.693479 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-53ff1102-dee2-4e95-955d-4866363a291c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:03.700161 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-739d97e3-6162-4b72-874b-a2a856e02288 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:03.701805 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-739d97e3-6162-4b72-874b-a2a856e02288 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:03.703364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-739d97e3-6162-4b72-874b-a2a856e02288 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:03.986325 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-739d97e3-6162-4b72-874b-a2a856e02288 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:03.995112 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-739d97e3-6162-4b72-874b-a2a856e02288 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.323588 Jun 16 00:27:03.998662 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 86/163] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:03 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:04.035195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-53ff1102-dee2-4e95-955d-4866363a291c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:04.044133 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-53ff1102-dee2-4e95-955d-4866363a291c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:04.046342 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-53ff1102-dee2-4e95-955d-4866363a291c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:04.047854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-53ff1102-dee2-4e95-955d-4866363a291c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.374793 Jun 16 00:27:04.048756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 78/164] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:03 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:04.105359 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4a8ccd91-9e42-4cab-83d4-95fc3887ed2c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:04.108524 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9154eb9d-3f99-473b-acba-0a491f965e58 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:04.108648 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4a8ccd91-9e42-4cab-83d4-95fc3887ed2c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:04.110392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9154eb9d-3f99-473b-acba-0a491f965e58 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:04.118020 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4a8ccd91-9e42-4cab-83d4-95fc3887ed2c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:04.118478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4a8ccd91-9e42-4cab-83d4-95fc3887ed2c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:04.118736 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9154eb9d-3f99-473b-acba-0a491f965e58 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:04.119407 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4a8ccd91-9e42-4cab-83d4-95fc3887ed2c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:04.119521 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9154eb9d-3f99-473b-acba-0a491f965e58 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:04.119872 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4a8ccd91-9e42-4cab-83d4-95fc3887ed2c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:04.120351 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9154eb9d-3f99-473b-acba-0a491f965e58 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:04.120858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9154eb9d-3f99-473b-acba-0a491f965e58 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:04.317747 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4a8ccd91-9e42-4cab-83d4-95fc3887ed2c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:04.324318 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9154eb9d-3f99-473b-acba-0a491f965e58 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:04.327036 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4a8ccd91-9e42-4cab-83d4-95fc3887ed2c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.225760 Jun 16 00:27:04.328316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 79/165] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:04 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:04.332149 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9154eb9d-3f99-473b-acba-0a491f965e58 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.234344 Jun 16 00:27:04.332719 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 87/166] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:04 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:05.015132 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-98c37db8-fd66-4e81-a269-9fac0320c6fc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:05.015860 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-98c37db8-fd66-4e81-a269-9fac0320c6fc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:05.021787 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-98c37db8-fd66-4e81-a269-9fac0320c6fc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:05.022328 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-98c37db8-fd66-4e81-a269-9fac0320c6fc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:05.023164 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-98c37db8-fd66-4e81-a269-9fac0320c6fc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:05.023758 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-98c37db8-fd66-4e81-a269-9fac0320c6fc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:05.066670 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-320bf0d3-c264-4cb8-af96-c1a54e99497e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:05.068118 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-320bf0d3-c264-4cb8-af96-c1a54e99497e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:05.075876 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-320bf0d3-c264-4cb8-af96-c1a54e99497e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:05.076641 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-320bf0d3-c264-4cb8-af96-c1a54e99497e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:05.078088 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-320bf0d3-c264-4cb8-af96-c1a54e99497e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:05.078864 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-320bf0d3-c264-4cb8-af96-c1a54e99497e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:05.245721 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-98c37db8-fd66-4e81-a269-9fac0320c6fc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:05.253046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-98c37db8-fd66-4e81-a269-9fac0320c6fc tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.242493 Jun 16 00:27:05.253609 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 80/167] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:05 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:05.290976 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-320bf0d3-c264-4cb8-af96-c1a54e99497e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:05.299337 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-320bf0d3-c264-4cb8-af96-c1a54e99497e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:05.300869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-320bf0d3-c264-4cb8-af96-c1a54e99497e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:05.301969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-320bf0d3-c264-4cb8-af96-c1a54e99497e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.239504 Jun 16 00:27:05.302532 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 88/168] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:05 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:05.344699 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-efd39c0f-2734-4a22-a840-7ed625187c9d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:05.345449 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-efd39c0f-2734-4a22-a840-7ed625187c9d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:05.348363 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ae57caf8-ccc5-493b-8fea-34c7b4bc485c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:05.348974 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ae57caf8-ccc5-493b-8fea-34c7b4bc485c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:05.351864 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-efd39c0f-2734-4a22-a840-7ed625187c9d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:05.352316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-efd39c0f-2734-4a22-a840-7ed625187c9d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:05.353075 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-efd39c0f-2734-4a22-a840-7ed625187c9d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:05.353506 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-efd39c0f-2734-4a22-a840-7ed625187c9d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:05.354827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ae57caf8-ccc5-493b-8fea-34c7b4bc485c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:05.355286 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ae57caf8-ccc5-493b-8fea-34c7b4bc485c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:05.356243 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ae57caf8-ccc5-493b-8fea-34c7b4bc485c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:05.356744 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ae57caf8-ccc5-493b-8fea-34c7b4bc485c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:05.563871 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ae57caf8-ccc5-493b-8fea-34c7b4bc485c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:05.566252 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-efd39c0f-2734-4a22-a840-7ed625187c9d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:05.572662 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ae57caf8-ccc5-493b-8fea-34c7b4bc485c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.227905 Jun 16 00:27:05.575447 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-efd39c0f-2734-4a22-a840-7ed625187c9d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.234631 Jun 16 00:27:05.575773 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 89/169] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:05 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:05.576174 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 81/170] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:05 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:06.270347 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-89cfca66-78c0-4707-99be-986b9f1024ba tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:06.271355 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-89cfca66-78c0-4707-99be-986b9f1024ba tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:06.278007 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89cfca66-78c0-4707-99be-986b9f1024ba tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:06.278464 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89cfca66-78c0-4707-99be-986b9f1024ba tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:06.279234 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89cfca66-78c0-4707-99be-986b9f1024ba tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:06.279797 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89cfca66-78c0-4707-99be-986b9f1024ba tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:06.320155 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-30011f89-13ee-4994-9cd7-2f3a8622d01f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:06.320875 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-30011f89-13ee-4994-9cd7-2f3a8622d01f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:06.327767 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-30011f89-13ee-4994-9cd7-2f3a8622d01f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:06.328265 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-30011f89-13ee-4994-9cd7-2f3a8622d01f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:06.329043 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-30011f89-13ee-4994-9cd7-2f3a8622d01f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:06.329479 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-30011f89-13ee-4994-9cd7-2f3a8622d01f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:06.472719 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-89cfca66-78c0-4707-99be-986b9f1024ba tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:06.481157 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-89cfca66-78c0-4707-99be-986b9f1024ba tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.214496 Jun 16 00:27:06.481741 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 82/171] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:06 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:06.502358 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-30011f89-13ee-4994-9cd7-2f3a8622d01f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:06.510138 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-30011f89-13ee-4994-9cd7-2f3a8622d01f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:06.511631 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-30011f89-13ee-4994-9cd7-2f3a8622d01f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:06.513007 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-30011f89-13ee-4994-9cd7-2f3a8622d01f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.196786 Jun 16 00:27:06.513553 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 90/172] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:06 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:06.589590 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-74b60fbb-4290-44d7-b298-32acd04ce6b1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:06.590190 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-74b60fbb-4290-44d7-b298-32acd04ce6b1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:06.596580 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-74b60fbb-4290-44d7-b298-32acd04ce6b1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:06.596720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-75663fd0-83a9-4138-b6f8-4526aba7003d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:06.597089 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-74b60fbb-4290-44d7-b298-32acd04ce6b1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:06.597336 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-75663fd0-83a9-4138-b6f8-4526aba7003d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:06.597767 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-74b60fbb-4290-44d7-b298-32acd04ce6b1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:06.599152 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-74b60fbb-4290-44d7-b298-32acd04ce6b1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:06.607417 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-75663fd0-83a9-4138-b6f8-4526aba7003d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:06.608108 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-75663fd0-83a9-4138-b6f8-4526aba7003d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:06.609579 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-75663fd0-83a9-4138-b6f8-4526aba7003d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:06.610013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-75663fd0-83a9-4138-b6f8-4526aba7003d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:06.614474 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=100 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:06.804768 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-74b60fbb-4290-44d7-b298-32acd04ce6b1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:06.814904 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-74b60fbb-4290-44d7-b298-32acd04ce6b1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.229212 Jun 16 00:27:06.815668 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 83/173] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:06 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:06.826258 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-75663fd0-83a9-4138-b6f8-4526aba7003d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:06.838552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-75663fd0-83a9-4138-b6f8-4526aba7003d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.249232 Jun 16 00:27:06.839112 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 91/174] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:06 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:07.498107 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2f8dd463-98f0-458f-8032-b0ca1cb4d122 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:07.499463 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2f8dd463-98f0-458f-8032-b0ca1cb4d122 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:07.505901 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2f8dd463-98f0-458f-8032-b0ca1cb4d122 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:07.506359 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2f8dd463-98f0-458f-8032-b0ca1cb4d122 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:07.507123 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2f8dd463-98f0-458f-8032-b0ca1cb4d122 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:07.507563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2f8dd463-98f0-458f-8032-b0ca1cb4d122 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:07.531064 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fada2b02-9049-4028-98a2-ba7e16729799 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:07.531711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fada2b02-9049-4028-98a2-ba7e16729799 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:07.537801 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fada2b02-9049-4028-98a2-ba7e16729799 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:07.538256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fada2b02-9049-4028-98a2-ba7e16729799 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:07.539029 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fada2b02-9049-4028-98a2-ba7e16729799 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:07.539467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fada2b02-9049-4028-98a2-ba7e16729799 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:07.691161 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2f8dd463-98f0-458f-8032-b0ca1cb4d122 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:07.698749 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2f8dd463-98f0-458f-8032-b0ca1cb4d122 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.205000 Jun 16 00:27:07.699317 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 84/175] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:07 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:07.722288 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fada2b02-9049-4028-98a2-ba7e16729799 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:07.730267 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fada2b02-9049-4028-98a2-ba7e16729799 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:07.731803 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fada2b02-9049-4028-98a2-ba7e16729799 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:07.732967 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fada2b02-9049-4028-98a2-ba7e16729799 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.206315 Jun 16 00:27:07.733510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 92/176] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:07 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:07.832185 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6ae0da06-abb9-4372-9d23-a99ff61ac780 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:07.832900 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6ae0da06-abb9-4372-9d23-a99ff61ac780 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:07.841080 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6ae0da06-abb9-4372-9d23-a99ff61ac780 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:07.841781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6ae0da06-abb9-4372-9d23-a99ff61ac780 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:07.843321 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6ae0da06-abb9-4372-9d23-a99ff61ac780 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:07.843905 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6ae0da06-abb9-4372-9d23-a99ff61ac780 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:07.857691 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-78e18a24-e2a5-419a-b07f-28c7cd35aa34 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:07.858895 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-78e18a24-e2a5-419a-b07f-28c7cd35aa34 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:07.866543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78e18a24-e2a5-419a-b07f-28c7cd35aa34 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:07.866992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78e18a24-e2a5-419a-b07f-28c7cd35aa34 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:07.867796 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78e18a24-e2a5-419a-b07f-28c7cd35aa34 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:07.868368 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78e18a24-e2a5-419a-b07f-28c7cd35aa34 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:08.050080 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6ae0da06-abb9-4372-9d23-a99ff61ac780 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:08.060437 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6ae0da06-abb9-4372-9d23-a99ff61ac780 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1320 microversion: 2.1 time: 0.232261 Jun 16 00:27:08.065031 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-78e18a24-e2a5-419a-b07f-28c7cd35aa34 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:08.070128 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 85/177] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:07 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1320 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:08.074109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-78e18a24-e2a5-419a-b07f-28c7cd35aa34 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.223223 Jun 16 00:27:08.074793 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 93/178] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:07 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:08.716086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-135a7e88-b3dd-4cad-a1d1-36a8f7e16dbf tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:08.716691 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-135a7e88-b3dd-4cad-a1d1-36a8f7e16dbf tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:08.723160 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-135a7e88-b3dd-4cad-a1d1-36a8f7e16dbf tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:08.723633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-135a7e88-b3dd-4cad-a1d1-36a8f7e16dbf tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:08.724399 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-135a7e88-b3dd-4cad-a1d1-36a8f7e16dbf tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:08.724836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-135a7e88-b3dd-4cad-a1d1-36a8f7e16dbf tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:08.750671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-53a628ec-8d72-4880-ae27-3da5e5c59298 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:08.752017 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-53a628ec-8d72-4880-ae27-3da5e5c59298 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:08.759386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-53a628ec-8d72-4880-ae27-3da5e5c59298 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:08.759903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-53a628ec-8d72-4880-ae27-3da5e5c59298 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:08.760645 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-53a628ec-8d72-4880-ae27-3da5e5c59298 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:08.761282 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-53a628ec-8d72-4880-ae27-3da5e5c59298 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:08.976476 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-135a7e88-b3dd-4cad-a1d1-36a8f7e16dbf tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:08.984112 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-135a7e88-b3dd-4cad-a1d1-36a8f7e16dbf tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1315 microversion: 2.1 time: 0.271635 Jun 16 00:27:08.993130 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 86/179] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:08 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:08.998671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-53a628ec-8d72-4880-ae27-3da5e5c59298 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:09.006557 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-53a628ec-8d72-4880-ae27-3da5e5c59298 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:09.008087 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-53a628ec-8d72-4880-ae27-3da5e5c59298 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:09.009193 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-53a628ec-8d72-4880-ae27-3da5e5c59298 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.262608 Jun 16 00:27:09.009733 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 94/180] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:08 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:09.078063 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0fe408f8-dd21-4be9-8a7a-42e5a9c9fde8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:09.078770 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0fe408f8-dd21-4be9-8a7a-42e5a9c9fde8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:09.085435 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0fe408f8-dd21-4be9-8a7a-42e5a9c9fde8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:09.086016 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0fe408f8-dd21-4be9-8a7a-42e5a9c9fde8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:09.086933 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0fe408f8-dd21-4be9-8a7a-42e5a9c9fde8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:09.087508 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0fe408f8-dd21-4be9-8a7a-42e5a9c9fde8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:09.091320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4afddb05-a9b0-4333-bc1d-d08a4d27ffc9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:09.091991 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4afddb05-a9b0-4333-bc1d-d08a4d27ffc9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:09.098741 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4afddb05-a9b0-4333-bc1d-d08a4d27ffc9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:09.099194 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4afddb05-a9b0-4333-bc1d-d08a4d27ffc9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:09.099994 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4afddb05-a9b0-4333-bc1d-d08a4d27ffc9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:09.100427 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4afddb05-a9b0-4333-bc1d-d08a4d27ffc9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:09.290071 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0fe408f8-dd21-4be9-8a7a-42e5a9c9fde8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:09.293307 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4afddb05-a9b0-4333-bc1d-d08a4d27ffc9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:09.298407 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0fe408f8-dd21-4be9-8a7a-42e5a9c9fde8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1514 microversion: 2.1 time: 0.224797 Jun 16 00:27:09.299046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 87/181] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:09 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:09.301690 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4afddb05-a9b0-4333-bc1d-d08a4d27ffc9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.214144 Jun 16 00:27:09.302614 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 95/182] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:09 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:09.315774 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bb4758d1-b010-4e58-b60d-f7d4d726fde2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:09.316795 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bb4758d1-b010-4e58-b60d-f7d4d726fde2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:09.323045 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb4758d1-b010-4e58-b60d-f7d4d726fde2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:09.323516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb4758d1-b010-4e58-b60d-f7d4d726fde2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:09.324364 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb4758d1-b010-4e58-b60d-f7d4d726fde2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:09.324761 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb4758d1-b010-4e58-b60d-f7d4d726fde2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:09.385352 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-bb4758d1-b010-4e58-b60d-f7d4d726fde2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lazy-loading 'flavor' on Instance uuid 8388df29-a591-4d4c-a77f-530d3f0e4693 {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:27:09.497432 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bb4758d1-b010-4e58-b60d-f7d4d726fde2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "POST /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693/action" status: 200 len: 32 microversion: 2.1 time: 0.185530 Jun 16 00:27:09.498056 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 88/183] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:27:09 2022] POST /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 00:27:09.508454 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e419dd2f-c88c-4dbc-8640-7ae4c68ac8ab tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:09.509110 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e419dd2f-c88c-4dbc-8640-7ae4c68ac8ab tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:09.516114 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e419dd2f-c88c-4dbc-8640-7ae4c68ac8ab tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:09.516576 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e419dd2f-c88c-4dbc-8640-7ae4c68ac8ab tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:09.517329 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e419dd2f-c88c-4dbc-8640-7ae4c68ac8ab tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:09.517802 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e419dd2f-c88c-4dbc-8640-7ae4c68ac8ab tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:09.649948 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e419dd2f-c88c-4dbc-8640-7ae4c68ac8ab tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:09.658560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e419dd2f-c88c-4dbc-8640-7ae4c68ac8ab tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.154297 Jun 16 00:27:09.659180 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 96/184] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:09 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:10.001857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-790e87df-0669-4018-b3c7-a956179b640a tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:10.002567 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-790e87df-0669-4018-b3c7-a956179b640a tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:10.008980 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-790e87df-0669-4018-b3c7-a956179b640a tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:10.009430 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-790e87df-0669-4018-b3c7-a956179b640a tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:10.010201 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-790e87df-0669-4018-b3c7-a956179b640a tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:10.010634 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-790e87df-0669-4018-b3c7-a956179b640a tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:10.027885 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-06e162a3-a74f-425b-80fc-7a057834a7ab tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:10.028697 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-06e162a3-a74f-425b-80fc-7a057834a7ab tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:10.035198 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-06e162a3-a74f-425b-80fc-7a057834a7ab tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:10.035813 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-06e162a3-a74f-425b-80fc-7a057834a7ab tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:10.036689 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-06e162a3-a74f-425b-80fc-7a057834a7ab tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:10.037224 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-06e162a3-a74f-425b-80fc-7a057834a7ab tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:10.257440 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-790e87df-0669-4018-b3c7-a956179b640a tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:10.272708 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-790e87df-0669-4018-b3c7-a956179b640a tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1501 microversion: 2.1 time: 0.275625 Jun 16 00:27:10.273285 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 89/185] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:09 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1501 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:10.281967 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-06e162a3-a74f-425b-80fc-7a057834a7ab tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:10.290688 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-06e162a3-a74f-425b-80fc-7a057834a7ab tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:10.292224 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-06e162a3-a74f-425b-80fc-7a057834a7ab tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:10.293334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-06e162a3-a74f-425b-80fc-7a057834a7ab tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.269554 Jun 16 00:27:10.294078 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 97/186] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:10 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:10.319389 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0868fc8d-5ef4-4c34-827e-ea80dbba0a85 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:10.320051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0868fc8d-5ef4-4c34-827e-ea80dbba0a85 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:10.326137 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0868fc8d-5ef4-4c34-827e-ea80dbba0a85 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:10.327223 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0868fc8d-5ef4-4c34-827e-ea80dbba0a85 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:10.328029 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0868fc8d-5ef4-4c34-827e-ea80dbba0a85 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:10.328604 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0868fc8d-5ef4-4c34-827e-ea80dbba0a85 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:10.580199 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0868fc8d-5ef4-4c34-827e-ea80dbba0a85 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:10.590498 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0868fc8d-5ef4-4c34-827e-ea80dbba0a85 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.274662 Jun 16 00:27:10.601478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 90/187] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:10 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:10.679001 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9b6213d7-8daa-4628-8295-c89a26efe772 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:10.680153 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9b6213d7-8daa-4628-8295-c89a26efe772 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:10.694647 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9b6213d7-8daa-4628-8295-c89a26efe772 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:10.698735 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9b6213d7-8daa-4628-8295-c89a26efe772 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:10.702988 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9b6213d7-8daa-4628-8295-c89a26efe772 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:10.707746 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9b6213d7-8daa-4628-8295-c89a26efe772 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:10.944756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-4870251f-dabb-490b-ab71-bc0ab8850ca1 req-137c4213-6d91-45f4-a7bf-9e765be94ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b84afb6-466c-477a-9339-b4a0ecef36be", "name": "network-vif-plugged", "status": "completed", "tag": "f807a98a-f8e6-4868-ab21-4008a07a1ae4"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:10.977627 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-4870251f-dabb-490b-ab71-bc0ab8850ca1 req-137c4213-6d91-45f4-a7bf-9e765be94ec6 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:10.979336 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-4870251f-dabb-490b-ab71-bc0ab8850ca1 req-137c4213-6d91-45f4-a7bf-9e765be94ec6 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:11.015261 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:11.043976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-4870251f-dabb-490b-ab71-bc0ab8850ca1 req-137c4213-6d91-45f4-a7bf-9e765be94ec6 service nova] Creating event network-vif-plugged:f807a98a-f8e6-4868-ab21-4008a07a1ae4 for instance 7b84afb6-466c-477a-9339-b4a0ecef36be on hv-cinder-84327 Jun 16 00:27:11.054266 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-4870251f-dabb-490b-ab71-bc0ab8850ca1 req-137c4213-6d91-45f4-a7bf-9e765be94ec6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115863 Jun 16 00:27:11.055678 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 91/188] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:11.078494 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9b6213d7-8daa-4628-8295-c89a26efe772 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:11.093399 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9b6213d7-8daa-4628-8295-c89a26efe772 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.419693 Jun 16 00:27:11.094000 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 98/189] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:10 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:11.328056 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bcef8aab-fb1d-46f0-b934-1e0a6f1074c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:11.329071 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bcef8aab-fb1d-46f0-b934-1e0a6f1074c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:11.335740 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bcef8aab-fb1d-46f0-b934-1e0a6f1074c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:11.336358 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bcef8aab-fb1d-46f0-b934-1e0a6f1074c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:11.337606 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bcef8aab-fb1d-46f0-b934-1e0a6f1074c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:11.338516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bcef8aab-fb1d-46f0-b934-1e0a6f1074c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:11.495291 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bcef8aab-fb1d-46f0-b934-1e0a6f1074c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:11.503413 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bcef8aab-fb1d-46f0-b934-1e0a6f1074c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:11.504993 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bcef8aab-fb1d-46f0-b934-1e0a6f1074c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:11.506021 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bcef8aab-fb1d-46f0-b934-1e0a6f1074c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.197718 Jun 16 00:27:11.506554 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 92/190] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:11 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:11.608586 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-19849e49-2fe3-487e-9629-908b9f51dc67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:11.609229 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-19849e49-2fe3-487e-9629-908b9f51dc67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:11.615396 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-19849e49-2fe3-487e-9629-908b9f51dc67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:11.615902 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-19849e49-2fe3-487e-9629-908b9f51dc67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:11.616656 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-19849e49-2fe3-487e-9629-908b9f51dc67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:11.617089 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-19849e49-2fe3-487e-9629-908b9f51dc67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:11.752417 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-19849e49-2fe3-487e-9629-908b9f51dc67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:11.759861 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-19849e49-2fe3-487e-9629-908b9f51dc67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.155268 Jun 16 00:27:11.760359 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 99/191] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:11 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:12.110129 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-098cfb75-c3b8-49c0-b4e4-8e0991a6c700 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:12.110854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-098cfb75-c3b8-49c0-b4e4-8e0991a6c700 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:12.117179 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-098cfb75-c3b8-49c0-b4e4-8e0991a6c700 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:12.117624 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-098cfb75-c3b8-49c0-b4e4-8e0991a6c700 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:12.118378 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-098cfb75-c3b8-49c0-b4e4-8e0991a6c700 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:12.118803 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-098cfb75-c3b8-49c0-b4e4-8e0991a6c700 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:12.181826 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a6e99ac3-85b7-4dd4-a874-54aa9b3c7a93 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e123c259-056f-433e-b010-50c375bf20a5"}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:12.183638 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a6e99ac3-85b7-4dd4-a874-54aa9b3c7a93 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:12.192798 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a6e99ac3-85b7-4dd4-a874-54aa9b3c7a93 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:12.192798 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a6e99ac3-85b7-4dd4-a874-54aa9b3c7a93 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:12.192798 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a6e99ac3-85b7-4dd4-a874-54aa9b3c7a93 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:12.192798 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a6e99ac3-85b7-4dd4-a874-54aa9b3c7a93 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:12.280288 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-098cfb75-c3b8-49c0-b4e4-8e0991a6c700 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:12.289560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-098cfb75-c3b8-49c0-b4e4-8e0991a6c700 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.183666 Jun 16 00:27:12.290127 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 93/192] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:12 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:12.523628 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-57c9547a-378c-4a0e-8ae3-5a907531fac3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:12.524244 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-57c9547a-378c-4a0e-8ae3-5a907531fac3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:12.530810 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-57c9547a-378c-4a0e-8ae3-5a907531fac3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:12.531256 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-57c9547a-378c-4a0e-8ae3-5a907531fac3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:12.532055 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-57c9547a-378c-4a0e-8ae3-5a907531fac3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:12.532486 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-57c9547a-378c-4a0e-8ae3-5a907531fac3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:12.670591 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-57c9547a-378c-4a0e-8ae3-5a907531fac3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:12.678529 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-57c9547a-378c-4a0e-8ae3-5a907531fac3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:12.680241 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-57c9547a-378c-4a0e-8ae3-5a907531fac3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:12.681364 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-57c9547a-378c-4a0e-8ae3-5a907531fac3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.161578 Jun 16 00:27:12.681909 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 94/193] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:12 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:12.777586 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0c5863b6-b8c9-4128-85be-3dfba50ae687 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:12.778196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0c5863b6-b8c9-4128-85be-3dfba50ae687 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:12.784329 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0c5863b6-b8c9-4128-85be-3dfba50ae687 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:12.784972 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0c5863b6-b8c9-4128-85be-3dfba50ae687 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:12.786441 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0c5863b6-b8c9-4128-85be-3dfba50ae687 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:12.786889 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0c5863b6-b8c9-4128-85be-3dfba50ae687 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:12.915632 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0c5863b6-b8c9-4128-85be-3dfba50ae687 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:12.924018 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0c5863b6-b8c9-4128-85be-3dfba50ae687 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.150151 Jun 16 00:27:12.924579 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 95/194] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:12 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:13.305953 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-be60d7cc-05ea-491e-b5e2-4f80cb7c19cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:13.306561 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-be60d7cc-05ea-491e-b5e2-4f80cb7c19cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:13.312485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-be60d7cc-05ea-491e-b5e2-4f80cb7c19cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:13.312934 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-be60d7cc-05ea-491e-b5e2-4f80cb7c19cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:13.313696 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-be60d7cc-05ea-491e-b5e2-4f80cb7c19cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:13.314165 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-be60d7cc-05ea-491e-b5e2-4f80cb7c19cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:13.454680 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-be60d7cc-05ea-491e-b5e2-4f80cb7c19cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:13.463075 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-be60d7cc-05ea-491e-b5e2-4f80cb7c19cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.160693 Jun 16 00:27:13.464189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 96/195] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:13 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:13.702281 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3778fbf2-ce64-4b9d-81a6-18f0fded6500 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:13.702902 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3778fbf2-ce64-4b9d-81a6-18f0fded6500 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:13.709209 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3778fbf2-ce64-4b9d-81a6-18f0fded6500 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:13.709668 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3778fbf2-ce64-4b9d-81a6-18f0fded6500 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:13.710446 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3778fbf2-ce64-4b9d-81a6-18f0fded6500 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:13.710880 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3778fbf2-ce64-4b9d-81a6-18f0fded6500 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:13.863161 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3778fbf2-ce64-4b9d-81a6-18f0fded6500 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:13.871018 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3778fbf2-ce64-4b9d-81a6-18f0fded6500 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:13.872538 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3778fbf2-ce64-4b9d-81a6-18f0fded6500 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:13.874189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3778fbf2-ce64-4b9d-81a6-18f0fded6500 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.178330 Jun 16 00:27:13.874920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 97/196] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:13 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:13.943060 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ec9c2230-355d-45f1-a2d4-2b2eba1715d4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:13.943785 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ec9c2230-355d-45f1-a2d4-2b2eba1715d4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:13.949948 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ec9c2230-355d-45f1-a2d4-2b2eba1715d4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:13.950404 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ec9c2230-355d-45f1-a2d4-2b2eba1715d4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:13.951989 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ec9c2230-355d-45f1-a2d4-2b2eba1715d4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:13.952507 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ec9c2230-355d-45f1-a2d4-2b2eba1715d4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:14.147812 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ec9c2230-355d-45f1-a2d4-2b2eba1715d4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:14.154052 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ec9c2230-355d-45f1-a2d4-2b2eba1715d4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.215870 Jun 16 00:27:14.155238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 98/197] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:13 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:14.480032 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9518d286-e7b9-4bc2-aa0b-504bcfd87ee6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:14.480759 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9518d286-e7b9-4bc2-aa0b-504bcfd87ee6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:14.487604 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9518d286-e7b9-4bc2-aa0b-504bcfd87ee6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:14.488086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9518d286-e7b9-4bc2-aa0b-504bcfd87ee6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:14.488977 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9518d286-e7b9-4bc2-aa0b-504bcfd87ee6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:14.489390 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9518d286-e7b9-4bc2-aa0b-504bcfd87ee6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:14.595113 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a6e99ac3-85b7-4dd4-a874-54aa9b3c7a93 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "POST /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.415006 Jun 16 00:27:14.597424 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 100/198] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:27:12 2022] POST /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3/os-volume_attachments => generated 194 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:14.699122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9518d286-e7b9-4bc2-aa0b-504bcfd87ee6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:14.708295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9518d286-e7b9-4bc2-aa0b-504bcfd87ee6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.232093 Jun 16 00:27:14.709587 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 99/199] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:14 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:14.894554 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-973c7813-6f31-43a1-9717-155a66debf4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:14.895807 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-973c7813-6f31-43a1-9717-155a66debf4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:14.906110 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-973c7813-6f31-43a1-9717-155a66debf4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:14.908121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-973c7813-6f31-43a1-9717-155a66debf4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:14.911388 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-973c7813-6f31-43a1-9717-155a66debf4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:14.914754 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-973c7813-6f31-43a1-9717-155a66debf4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:15.136032 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-973c7813-6f31-43a1-9717-155a66debf4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:15.144367 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-973c7813-6f31-43a1-9717-155a66debf4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:15.145808 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-973c7813-6f31-43a1-9717-155a66debf4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:15.146904 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-973c7813-6f31-43a1-9717-155a66debf4b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.256955 Jun 16 00:27:15.147738 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 101/200] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:14 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:15.173011 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-adb8c24e-0a17-4bd9-9190-4da1f69fed60 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:15.173761 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-adb8c24e-0a17-4bd9-9190-4da1f69fed60 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:15.179700 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-adb8c24e-0a17-4bd9-9190-4da1f69fed60 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:15.180268 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-adb8c24e-0a17-4bd9-9190-4da1f69fed60 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:15.181110 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-adb8c24e-0a17-4bd9-9190-4da1f69fed60 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:15.181586 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-adb8c24e-0a17-4bd9-9190-4da1f69fed60 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:15.314664 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-adb8c24e-0a17-4bd9-9190-4da1f69fed60 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:15.322160 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-adb8c24e-0a17-4bd9-9190-4da1f69fed60 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.153430 Jun 16 00:27:15.322661 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 100/201] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:15 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:15.726210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-13517daf-610f-4e17-a61e-f1163e7e217c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:15.727330 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-13517daf-610f-4e17-a61e-f1163e7e217c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:15.735053 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-13517daf-610f-4e17-a61e-f1163e7e217c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:15.736062 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-13517daf-610f-4e17-a61e-f1163e7e217c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:15.736850 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-13517daf-610f-4e17-a61e-f1163e7e217c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:15.737283 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-13517daf-610f-4e17-a61e-f1163e7e217c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:15.871471 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-13517daf-610f-4e17-a61e-f1163e7e217c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:15.879118 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-13517daf-610f-4e17-a61e-f1163e7e217c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.156651 Jun 16 00:27:15.879693 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 102/202] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:15 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:16.165048 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f2921b74-f6ab-4a1d-90e8-9a8e5d8a8e33 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:16.165655 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f2921b74-f6ab-4a1d-90e8-9a8e5d8a8e33 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:16.172302 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f2921b74-f6ab-4a1d-90e8-9a8e5d8a8e33 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:16.172749 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f2921b74-f6ab-4a1d-90e8-9a8e5d8a8e33 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:16.173536 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f2921b74-f6ab-4a1d-90e8-9a8e5d8a8e33 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:16.173955 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f2921b74-f6ab-4a1d-90e8-9a8e5d8a8e33 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:16.339803 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-79faaf05-b603-4477-9801-7857e8987693 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:16.340418 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-79faaf05-b603-4477-9801-7857e8987693 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:16.350949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-79faaf05-b603-4477-9801-7857e8987693 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:16.351700 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-79faaf05-b603-4477-9801-7857e8987693 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:16.352511 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-79faaf05-b603-4477-9801-7857e8987693 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:16.353113 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-79faaf05-b603-4477-9801-7857e8987693 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:16.550774 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f2921b74-f6ab-4a1d-90e8-9a8e5d8a8e33 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:16.553485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-79faaf05-b603-4477-9801-7857e8987693 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:16.560047 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f2921b74-f6ab-4a1d-90e8-9a8e5d8a8e33 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:16.561623 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-79faaf05-b603-4477-9801-7857e8987693 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.225670 Jun 16 00:27:16.562339 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f2921b74-f6ab-4a1d-90e8-9a8e5d8a8e33 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:16.563933 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f2921b74-f6ab-4a1d-90e8-9a8e5d8a8e33 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.402803 Jun 16 00:27:16.565053 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 101/204] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:16 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:16.570980 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 103/204] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:16 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:16.896888 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4b1f103a-ca9a-4512-b519-cff50f71025b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:16.897542 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4b1f103a-ca9a-4512-b519-cff50f71025b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:16.903564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4b1f103a-ca9a-4512-b519-cff50f71025b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:16.904045 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4b1f103a-ca9a-4512-b519-cff50f71025b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:16.905310 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4b1f103a-ca9a-4512-b519-cff50f71025b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:16.905740 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4b1f103a-ca9a-4512-b519-cff50f71025b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:17.042572 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4b1f103a-ca9a-4512-b519-cff50f71025b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:17.050180 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4b1f103a-ca9a-4512-b519-cff50f71025b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.157081 Jun 16 00:27:17.050948 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 102/205] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:16 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:17.578332 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-63fa7025-219b-4d2c-afc3-543c170eb38f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:17.578998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-63fa7025-219b-4d2c-afc3-543c170eb38f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:17.581038 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e266f86e-d3bf-42bc-9e6a-000b473ab224 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:17.581646 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e266f86e-d3bf-42bc-9e6a-000b473ab224 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:17.585729 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63fa7025-219b-4d2c-afc3-543c170eb38f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:17.586182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63fa7025-219b-4d2c-afc3-543c170eb38f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:17.586945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63fa7025-219b-4d2c-afc3-543c170eb38f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:17.587379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63fa7025-219b-4d2c-afc3-543c170eb38f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:17.587573 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e266f86e-d3bf-42bc-9e6a-000b473ab224 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:17.588054 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e266f86e-d3bf-42bc-9e6a-000b473ab224 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:17.588824 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e266f86e-d3bf-42bc-9e6a-000b473ab224 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:17.589262 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e266f86e-d3bf-42bc-9e6a-000b473ab224 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:17.783307 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-63fa7025-219b-4d2c-afc3-543c170eb38f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:17.788221 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e266f86e-d3bf-42bc-9e6a-000b473ab224 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:17.791367 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-63fa7025-219b-4d2c-afc3-543c170eb38f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.216918 Jun 16 00:27:17.791957 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 104/206] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:17 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:17.797078 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e266f86e-d3bf-42bc-9e6a-000b473ab224 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:17.799714 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e266f86e-d3bf-42bc-9e6a-000b473ab224 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:17.801325 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e266f86e-d3bf-42bc-9e6a-000b473ab224 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.223649 Jun 16 00:27:17.801699 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 103/207] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:17 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:18.066769 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-80ed019a-2e82-428e-9ca3-3ada8d1c6a8e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:18.067285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-80ed019a-2e82-428e-9ca3-3ada8d1c6a8e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:18.073253 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-80ed019a-2e82-428e-9ca3-3ada8d1c6a8e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:18.073696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-80ed019a-2e82-428e-9ca3-3ada8d1c6a8e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:18.074441 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-80ed019a-2e82-428e-9ca3-3ada8d1c6a8e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:18.074871 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-80ed019a-2e82-428e-9ca3-3ada8d1c6a8e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:18.203940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-80ed019a-2e82-428e-9ca3-3ada8d1c6a8e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:18.211298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-80ed019a-2e82-428e-9ca3-3ada8d1c6a8e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.148395 Jun 16 00:27:18.211878 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 105/208] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:18 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:18.808411 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a8b6fa83-4af6-4b19-82d5-00e14c95c5e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:18.809073 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a8b6fa83-4af6-4b19-82d5-00e14c95c5e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:18.816038 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a8b6fa83-4af6-4b19-82d5-00e14c95c5e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:18.816490 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a8b6fa83-4af6-4b19-82d5-00e14c95c5e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:18.817255 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a8b6fa83-4af6-4b19-82d5-00e14c95c5e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:18.817854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a8b6fa83-4af6-4b19-82d5-00e14c95c5e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:18.818485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-790f5137-44b5-4920-9267-5bafeacef752 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:18.819087 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-790f5137-44b5-4920-9267-5bafeacef752 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:18.825737 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-790f5137-44b5-4920-9267-5bafeacef752 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:18.826189 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-790f5137-44b5-4920-9267-5bafeacef752 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:18.826950 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-790f5137-44b5-4920-9267-5bafeacef752 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:18.827377 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-790f5137-44b5-4920-9267-5bafeacef752 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:18.842064 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:19.012247 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a8b6fa83-4af6-4b19-82d5-00e14c95c5e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:19.018782 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-790f5137-44b5-4920-9267-5bafeacef752 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:19.019666 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a8b6fa83-4af6-4b19-82d5-00e14c95c5e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.215227 Jun 16 00:27:19.020229 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 104/209] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:18 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:19.026713 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-790f5137-44b5-4920-9267-5bafeacef752 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:19.028264 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-790f5137-44b5-4920-9267-5bafeacef752 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:19.029875 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-790f5137-44b5-4920-9267-5bafeacef752 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.214726 Jun 16 00:27:19.030413 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 106/210] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:18 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:19.227741 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-20c39773-e97f-4e3b-85c6-8e1bf68aae1b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:19.228380 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-20c39773-e97f-4e3b-85c6-8e1bf68aae1b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:19.234423 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-20c39773-e97f-4e3b-85c6-8e1bf68aae1b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:19.234866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-20c39773-e97f-4e3b-85c6-8e1bf68aae1b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:19.235629 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-20c39773-e97f-4e3b-85c6-8e1bf68aae1b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:19.236063 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-20c39773-e97f-4e3b-85c6-8e1bf68aae1b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:19.365368 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-20c39773-e97f-4e3b-85c6-8e1bf68aae1b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:19.372829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-20c39773-e97f-4e3b-85c6-8e1bf68aae1b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.148764 Jun 16 00:27:19.373889 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 105/211] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:19 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:20.037461 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cea20d7d-f44b-432f-9155-8c365c260430 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:20.038164 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-cea20d7d-f44b-432f-9155-8c365c260430 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:20.044611 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cea20d7d-f44b-432f-9155-8c365c260430 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:20.045251 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cea20d7d-f44b-432f-9155-8c365c260430 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:20.046208 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cea20d7d-f44b-432f-9155-8c365c260430 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:20.046644 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cea20d7d-f44b-432f-9155-8c365c260430 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:20.047825 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-12e0931f-7eec-45eb-9c74-2c608a0e7a9a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:20.048449 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-12e0931f-7eec-45eb-9c74-2c608a0e7a9a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:20.054835 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-12e0931f-7eec-45eb-9c74-2c608a0e7a9a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:20.055492 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-12e0931f-7eec-45eb-9c74-2c608a0e7a9a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:20.056528 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-12e0931f-7eec-45eb-9c74-2c608a0e7a9a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:20.057008 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-12e0931f-7eec-45eb-9c74-2c608a0e7a9a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:20.258740 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-cea20d7d-f44b-432f-9155-8c365c260430 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:20.268300 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-12e0931f-7eec-45eb-9c74-2c608a0e7a9a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:20.275914 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-cea20d7d-f44b-432f-9155-8c365c260430 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.243077 Jun 16 00:27:20.276481 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 107/212] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:20 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:20.280826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-12e0931f-7eec-45eb-9c74-2c608a0e7a9a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:20.282597 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-12e0931f-7eec-45eb-9c74-2c608a0e7a9a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:20.283830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-12e0931f-7eec-45eb-9c74-2c608a0e7a9a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1407 microversion: 2.20 time: 0.240212 Jun 16 00:27:20.284372 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 106/213] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:20 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:27:20.390695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-82aecd60-1436-47ac-b6ff-d249541c1af8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:20.391296 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-82aecd60-1436-47ac-b6ff-d249541c1af8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:20.397270 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-82aecd60-1436-47ac-b6ff-d249541c1af8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:20.398061 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-82aecd60-1436-47ac-b6ff-d249541c1af8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:20.398784 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-82aecd60-1436-47ac-b6ff-d249541c1af8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:20.399379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-82aecd60-1436-47ac-b6ff-d249541c1af8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:20.543184 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-82aecd60-1436-47ac-b6ff-d249541c1af8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:20.550858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-82aecd60-1436-47ac-b6ff-d249541c1af8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.164577 Jun 16 00:27:20.561189 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 108/214] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:20 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:21.293210 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7011442b-1ace-43a9-af51-4d7b7b35ff67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:21.294000 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7011442b-1ace-43a9-af51-4d7b7b35ff67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:21.305228 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7011442b-1ace-43a9-af51-4d7b7b35ff67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.306208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7011442b-1ace-43a9-af51-4d7b7b35ff67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:21.307298 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7011442b-1ace-43a9-af51-4d7b7b35ff67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.307990 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7011442b-1ace-43a9-af51-4d7b7b35ff67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:21.313071 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c9d2d234-f67f-4260-9295-a8b321f21969 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:21.316725 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c9d2d234-f67f-4260-9295-a8b321f21969 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:21.334913 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c9d2d234-f67f-4260-9295-a8b321f21969 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.335871 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c9d2d234-f67f-4260-9295-a8b321f21969 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:21.336674 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c9d2d234-f67f-4260-9295-a8b321f21969 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.337492 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c9d2d234-f67f-4260-9295-a8b321f21969 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:21.622608 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7011442b-1ace-43a9-af51-4d7b7b35ff67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:21.630772 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c9d2d234-f67f-4260-9295-a8b321f21969 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:21.630998 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7011442b-1ace-43a9-af51-4d7b7b35ff67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.342125 Jun 16 00:27:21.631601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 107/215] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:21 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:21.637017 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-40fa5f0d-3bf6-44b5-b496-bf829bc7b40e req-5b3adbf7-9ada-4e4c-a2bd-9ab40de672c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0940a4aa-71c4-4a96-8106-40dd8b012547", "name": "network-vif-plugged", "status": "completed", "tag": "24633b83-4728-4103-8fab-2eb65a801405"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:21.643966 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c9d2d234-f67f-4260-9295-a8b321f21969 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:21.645467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c9d2d234-f67f-4260-9295-a8b321f21969 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:21.646623 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c9d2d234-f67f-4260-9295-a8b321f21969 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1598 microversion: 2.20 time: 0.346947 Jun 16 00:27:21.647306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-40fa5f0d-3bf6-44b5-b496-bf829bc7b40e req-5b3adbf7-9ada-4e4c-a2bd-9ab40de672c0 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.647434 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 109/216] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:27:21 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1598 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:21.651740 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-75a0b850-1da7-4d19-b2e6-6c7f49e38cac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:21.652335 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-75a0b850-1da7-4d19-b2e6-6c7f49e38cac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:21.656417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-40fa5f0d-3bf6-44b5-b496-bf829bc7b40e req-5b3adbf7-9ada-4e4c-a2bd-9ab40de672c0 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:21.660053 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-75a0b850-1da7-4d19-b2e6-6c7f49e38cac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.660764 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-75a0b850-1da7-4d19-b2e6-6c7f49e38cac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:21.661745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-75a0b850-1da7-4d19-b2e6-6c7f49e38cac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.662239 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-75a0b850-1da7-4d19-b2e6-6c7f49e38cac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:21.675348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-40fa5f0d-3bf6-44b5-b496-bf829bc7b40e req-5b3adbf7-9ada-4e4c-a2bd-9ab40de672c0 service nova] Creating event network-vif-plugged:24633b83-4728-4103-8fab-2eb65a801405 for instance 0940a4aa-71c4-4a96-8106-40dd8b012547 on hv-cinder-84327 Jun 16 00:27:21.681460 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-40fa5f0d-3bf6-44b5-b496-bf829bc7b40e req-5b3adbf7-9ada-4e4c-a2bd-9ab40de672c0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048415 Jun 16 00:27:21.682028 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 108/217] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:21.688795 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ae85af78-fc64-496f-8afe-5cabb7c7409c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:21.690474 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ae85af78-fc64-496f-8afe-5cabb7c7409c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:21.698854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ae85af78-fc64-496f-8afe-5cabb7c7409c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.699756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ae85af78-fc64-496f-8afe-5cabb7c7409c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:21.701928 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ae85af78-fc64-496f-8afe-5cabb7c7409c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:21.702614 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ae85af78-fc64-496f-8afe-5cabb7c7409c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:21.707552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=100 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:21.844698 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ae85af78-fc64-496f-8afe-5cabb7c7409c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.160061 Jun 16 00:27:21.845791 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 109/218] 10.222.0.44 () {60 vars in 1315 bytes} [Thu Jun 16 00:27:21 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:27:21.881827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-75a0b850-1da7-4d19-b2e6-6c7f49e38cac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:21.891957 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-75a0b850-1da7-4d19-b2e6-6c7f49e38cac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.243558 Jun 16 00:27:21.892527 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 110/219] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:21 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:22.649076 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7171a1b4-db43-45a4-8e01-c5c0ac9769ea tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:22.650386 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7171a1b4-db43-45a4-8e01-c5c0ac9769ea tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:22.657514 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7171a1b4-db43-45a4-8e01-c5c0ac9769ea tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:22.658273 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7171a1b4-db43-45a4-8e01-c5c0ac9769ea tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:22.659253 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7171a1b4-db43-45a4-8e01-c5c0ac9769ea tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:22.659703 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7171a1b4-db43-45a4-8e01-c5c0ac9769ea tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:22.908664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6912e2c1-9d60-4692-a144-459edbf303e0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:22.909457 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-6912e2c1-9d60-4692-a144-459edbf303e0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:22.916719 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6912e2c1-9d60-4692-a144-459edbf303e0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:22.917223 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6912e2c1-9d60-4692-a144-459edbf303e0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:22.917984 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6912e2c1-9d60-4692-a144-459edbf303e0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:22.918571 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6912e2c1-9d60-4692-a144-459edbf303e0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:23.183751 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7171a1b4-db43-45a4-8e01-c5c0ac9769ea tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:23.196552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7171a1b4-db43-45a4-8e01-c5c0ac9769ea tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.551011 Jun 16 00:27:23.198594 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 110/220] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:22 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:23.290491 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-6912e2c1-9d60-4692-a144-459edbf303e0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:23.308330 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-6912e2c1-9d60-4692-a144-459edbf303e0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.404274 Jun 16 00:27:23.309704 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 111/221] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:22 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:23.836738 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-5a3e624e-3881-4b0c-92f0-2e0e04f36102 req-af3a1eb0-c861-4244-97d0-ac62ba4b9f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b84afb6-466c-477a-9339-b4a0ecef36be", "tag": "f807a98a-f8e6-4868-ab21-4008a07a1ae4"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:23.849454 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-5a3e624e-3881-4b0c-92f0-2e0e04f36102 req-af3a1eb0-c861-4244-97d0-ac62ba4b9f02 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:23.850547 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-5a3e624e-3881-4b0c-92f0-2e0e04f36102 req-af3a1eb0-c861-4244-97d0-ac62ba4b9f02 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:23.867185 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-5a3e624e-3881-4b0c-92f0-2e0e04f36102 req-af3a1eb0-c861-4244-97d0-ac62ba4b9f02 service nova] Creating event network-changed:f807a98a-f8e6-4868-ab21-4008a07a1ae4 for instance 7b84afb6-466c-477a-9339-b4a0ecef36be on hv-cinder-84327 Jun 16 00:27:23.875102 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-5a3e624e-3881-4b0c-92f0-2e0e04f36102 req-af3a1eb0-c861-4244-97d0-ac62ba4b9f02 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047538 Jun 16 00:27:23.876633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 111/222] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:24.215145 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-15c52da7-86c4-4dfb-99e9-f2ab46d32019 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:24.215874 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-15c52da7-86c4-4dfb-99e9-f2ab46d32019 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:24.230413 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-15c52da7-86c4-4dfb-99e9-f2ab46d32019 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:24.233481 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-15c52da7-86c4-4dfb-99e9-f2ab46d32019 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:24.234969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-15c52da7-86c4-4dfb-99e9-f2ab46d32019 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:24.237895 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-15c52da7-86c4-4dfb-99e9-f2ab46d32019 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:24.326780 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5bb79dd5-df36-497b-a05f-7e4b73dd6ead tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:24.327935 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5bb79dd5-df36-497b-a05f-7e4b73dd6ead tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:24.343746 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5bb79dd5-df36-497b-a05f-7e4b73dd6ead tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:24.348212 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5bb79dd5-df36-497b-a05f-7e4b73dd6ead tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:24.349762 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5bb79dd5-df36-497b-a05f-7e4b73dd6ead tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:24.351875 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5bb79dd5-df36-497b-a05f-7e4b73dd6ead tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:24.546679 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-15c52da7-86c4-4dfb-99e9-f2ab46d32019 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:24.563268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-15c52da7-86c4-4dfb-99e9-f2ab46d32019 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.352636 Jun 16 00:27:24.574733 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 112/223] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:24 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:24.618833 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5bb79dd5-df36-497b-a05f-7e4b73dd6ead tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:24.629631 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5bb79dd5-df36-497b-a05f-7e4b73dd6ead tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.307105 Jun 16 00:27:24.633444 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 112/224] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:24 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:25.582803 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e56d2278-1a76-46cc-a019-d9e786eb2f13 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:25.583435 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e56d2278-1a76-46cc-a019-d9e786eb2f13 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:25.599714 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e56d2278-1a76-46cc-a019-d9e786eb2f13 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:25.605881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e56d2278-1a76-46cc-a019-d9e786eb2f13 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:25.608315 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e56d2278-1a76-46cc-a019-d9e786eb2f13 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:25.610039 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e56d2278-1a76-46cc-a019-d9e786eb2f13 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:25.649803 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b786529e-678c-4b96-a888-2f5d7d1bf5a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:25.652072 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b786529e-678c-4b96-a888-2f5d7d1bf5a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:25.659197 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b786529e-678c-4b96-a888-2f5d7d1bf5a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:25.659851 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b786529e-678c-4b96-a888-2f5d7d1bf5a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:25.660634 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b786529e-678c-4b96-a888-2f5d7d1bf5a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:25.661370 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b786529e-678c-4b96-a888-2f5d7d1bf5a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:25.862962 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b786529e-678c-4b96-a888-2f5d7d1bf5a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:25.863517 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e56d2278-1a76-46cc-a019-d9e786eb2f13 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:25.871930 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b786529e-678c-4b96-a888-2f5d7d1bf5a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.225763 Jun 16 00:27:25.872818 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e56d2278-1a76-46cc-a019-d9e786eb2f13 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.296873 Jun 16 00:27:25.873239 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 113/225] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:25 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:25.876038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 113/226] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:25 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:26.895351 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c8bf7e1b-a7ce-461b-bb26-6e808e7158e5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:26.897565 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-59ca3222-1cab-4305-97ae-ceb181a7e64f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:26.898170 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-59ca3222-1cab-4305-97ae-ceb181a7e64f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:26.901410 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c8bf7e1b-a7ce-461b-bb26-6e808e7158e5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:26.915278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-59ca3222-1cab-4305-97ae-ceb181a7e64f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:26.915765 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-59ca3222-1cab-4305-97ae-ceb181a7e64f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:26.917570 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c8bf7e1b-a7ce-461b-bb26-6e808e7158e5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:26.918759 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c8bf7e1b-a7ce-461b-bb26-6e808e7158e5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:26.919741 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-59ca3222-1cab-4305-97ae-ceb181a7e64f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:26.920194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-59ca3222-1cab-4305-97ae-ceb181a7e64f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:26.923635 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c8bf7e1b-a7ce-461b-bb26-6e808e7158e5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:26.924284 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c8bf7e1b-a7ce-461b-bb26-6e808e7158e5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:27.297833 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-59ca3222-1cab-4305-97ae-ceb181a7e64f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:27.299220 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c8bf7e1b-a7ce-461b-bb26-6e808e7158e5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:27.308404 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c8bf7e1b-a7ce-461b-bb26-6e808e7158e5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.419413 Jun 16 00:27:27.309749 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-59ca3222-1cab-4305-97ae-ceb181a7e64f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.423691 Jun 16 00:27:27.310322 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 114/227] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:26 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:27.349327 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 114/228] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:26 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:28.336860 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-823298d5-b450-4210-81bd-21c9ae239953 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:28.337405 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8f220569-3457-4d63-96a0-84307ad0bf86 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:28.337775 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8f220569-3457-4d63-96a0-84307ad0bf86 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:28.337874 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-823298d5-b450-4210-81bd-21c9ae239953 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:28.344163 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-823298d5-b450-4210-81bd-21c9ae239953 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:28.344312 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8f220569-3457-4d63-96a0-84307ad0bf86 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:28.344622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8f220569-3457-4d63-96a0-84307ad0bf86 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:28.344901 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-823298d5-b450-4210-81bd-21c9ae239953 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:28.345378 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8f220569-3457-4d63-96a0-84307ad0bf86 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:28.345681 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-823298d5-b450-4210-81bd-21c9ae239953 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:28.345809 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8f220569-3457-4d63-96a0-84307ad0bf86 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:28.346142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-823298d5-b450-4210-81bd-21c9ae239953 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:28.545132 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-823298d5-b450-4210-81bd-21c9ae239953 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:28.545834 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8f220569-3457-4d63-96a0-84307ad0bf86 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:28.551224 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-823298d5-b450-4210-81bd-21c9ae239953 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.218596 Jun 16 00:27:28.560928 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 115/229] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:28 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:28.561061 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8f220569-3457-4d63-96a0-84307ad0bf86 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.220825 Jun 16 00:27:28.561061 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 115/230] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:28 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:29.567816 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-53e2de6b-2910-47f9-8a9b-37cd8290cd17 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:29.568544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-53e2de6b-2910-47f9-8a9b-37cd8290cd17 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:29.570782 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-451d16a1-7437-4f4e-90ba-78d3152fe2db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:29.571397 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-451d16a1-7437-4f4e-90ba-78d3152fe2db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:29.573869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=76 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:29.575928 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-53e2de6b-2910-47f9-8a9b-37cd8290cd17 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:29.576533 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-53e2de6b-2910-47f9-8a9b-37cd8290cd17 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:29.577481 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-53e2de6b-2910-47f9-8a9b-37cd8290cd17 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:29.578017 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-53e2de6b-2910-47f9-8a9b-37cd8290cd17 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:29.583045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-451d16a1-7437-4f4e-90ba-78d3152fe2db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:29.583779 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-451d16a1-7437-4f4e-90ba-78d3152fe2db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:29.584755 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-451d16a1-7437-4f4e-90ba-78d3152fe2db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:29.585364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-451d16a1-7437-4f4e-90ba-78d3152fe2db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:29.968019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-53e2de6b-2910-47f9-8a9b-37cd8290cd17 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:29.977357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-53e2de6b-2910-47f9-8a9b-37cd8290cd17 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1366 microversion: 2.1 time: 0.413020 Jun 16 00:27:29.977665 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 116/231] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:29 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:29.985580 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1608512969", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "networks": [{"uuid": "a37abb5e-6a4b-4bf6-9a54-2314698f04e2"}]}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:29.992555 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-451d16a1-7437-4f4e-90ba-78d3152fe2db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:30.000294 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-451d16a1-7437-4f4e-90ba-78d3152fe2db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.433363 Jun 16 00:27:30.000866 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 116/232] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:29 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:30.039455 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] validate_networks() for [('a37abb5e-6a4b-4bf6-9a54-2314698f04e2', None, None, None, None, None)] {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:27:30.408643 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:27:30.409069 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:27:30.409559 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:27:30.409955 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:27:30.410967 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:27:30.418428 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=92 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:30.429570 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:30.430249 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:30.431156 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:30.431603 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:30.451275 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Getting quotas for project 572e79ce0a7c49b784aa301e367a176b. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:27:30.455283 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Getting quotas for user 4cca20d97f474e52bf6581a6a8c57670 and project 572e79ce0a7c49b784aa301e367a176b. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:27:30.466123 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:27:30.468400 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:27:30.516577 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d2d85d5c-61fd-4650-b676-d636a6b7f1e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537264 Jun 16 00:27:30.517383 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 117/233] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:27:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:27:30.529711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d623ef06-f2d2-4ebe-86f8-da611ec2edb6 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:30.530518 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d623ef06-f2d2-4ebe-86f8-da611ec2edb6 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:30.586229 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d623ef06-f2d2-4ebe-86f8-da611ec2edb6 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:30.593451 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d623ef06-f2d2-4ebe-86f8-da611ec2edb6 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1214 microversion: 2.1 time: 0.069271 Jun 16 00:27:30.594054 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 117/234] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:30 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:30.994065 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-44a95d3b-9fde-444f-b621-7491bf2617ac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:30.994674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-44a95d3b-9fde-444f-b621-7491bf2617ac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:31.001239 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-44a95d3b-9fde-444f-b621-7491bf2617ac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:31.001684 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-44a95d3b-9fde-444f-b621-7491bf2617ac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:31.002469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-44a95d3b-9fde-444f-b621-7491bf2617ac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:31.002906 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-44a95d3b-9fde-444f-b621-7491bf2617ac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:31.018945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fbfb863e-6aa9-4926-9060-3e108738f6e8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:31.019745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fbfb863e-6aa9-4926-9060-3e108738f6e8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:31.026204 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fbfb863e-6aa9-4926-9060-3e108738f6e8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:31.026840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fbfb863e-6aa9-4926-9060-3e108738f6e8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:31.027928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fbfb863e-6aa9-4926-9060-3e108738f6e8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:31.029107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fbfb863e-6aa9-4926-9060-3e108738f6e8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:31.246717 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-44a95d3b-9fde-444f-b621-7491bf2617ac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:31.250493 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fbfb863e-6aa9-4926-9060-3e108738f6e8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:31.258805 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fbfb863e-6aa9-4926-9060-3e108738f6e8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.243878 Jun 16 00:27:31.259366 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 118/235] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:31 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:31.270911 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-44a95d3b-9fde-444f-b621-7491bf2617ac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1555 microversion: 2.1 time: 0.280578 Jun 16 00:27:31.271433 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 118/236] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:30 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1555 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:31.287955 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-304e6bca-27cb-4510-b534-5452ec8cb733 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:31.288523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-304e6bca-27cb-4510-b534-5452ec8cb733 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:31.294604 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-304e6bca-27cb-4510-b534-5452ec8cb733 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:31.295053 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-304e6bca-27cb-4510-b534-5452ec8cb733 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:31.295855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-304e6bca-27cb-4510-b534-5452ec8cb733 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:31.296281 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-304e6bca-27cb-4510-b534-5452ec8cb733 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:31.382455 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-304e6bca-27cb-4510-b534-5452ec8cb733 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098035 Jun 16 00:27:31.383293 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 119/237] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 16 00:27:31 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:31.610505 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-67168310-c215-4130-9d61-4e31fee6d6e2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:31.611012 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-67168310-c215-4130-9d61-4e31fee6d6e2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:31.620622 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-67168310-c215-4130-9d61-4e31fee6d6e2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:31.621689 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-67168310-c215-4130-9d61-4e31fee6d6e2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:31.641799 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-67168310-c215-4130-9d61-4e31fee6d6e2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:31.643954 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-67168310-c215-4130-9d61-4e31fee6d6e2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:31.752815 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-67168310-c215-4130-9d61-4e31fee6d6e2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:31.761238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-67168310-c215-4130-9d61-4e31fee6d6e2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1210 microversion: 2.1 time: 0.154782 Jun 16 00:27:31.762527 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 119/238] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:31 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:32.279096 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d614dedc-cbc4-4046-a952-265c42478096 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:32.280544 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d614dedc-cbc4-4046-a952-265c42478096 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:32.296345 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d614dedc-cbc4-4046-a952-265c42478096 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:32.301886 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d614dedc-cbc4-4046-a952-265c42478096 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:32.302936 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d614dedc-cbc4-4046-a952-265c42478096 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:32.303558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d614dedc-cbc4-4046-a952-265c42478096 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:32.660439 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d614dedc-cbc4-4046-a952-265c42478096 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:32.676155 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d614dedc-cbc4-4046-a952-265c42478096 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.395518 Jun 16 00:27:32.677385 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 120/239] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:32 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:32.781694 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8fa4fd23-bdbe-4528-b7c7-13208f454910 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:32.782826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8fa4fd23-bdbe-4528-b7c7-13208f454910 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:32.794601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8fa4fd23-bdbe-4528-b7c7-13208f454910 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:32.795064 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8fa4fd23-bdbe-4528-b7c7-13208f454910 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:32.799201 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8fa4fd23-bdbe-4528-b7c7-13208f454910 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:32.801968 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8fa4fd23-bdbe-4528-b7c7-13208f454910 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:32.881434 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8fa4fd23-bdbe-4528-b7c7-13208f454910 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:32.893504 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8fa4fd23-bdbe-4528-b7c7-13208f454910 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1272 microversion: 2.1 time: 0.115920 Jun 16 00:27:32.895190 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 120/240] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:32 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:33.032393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-99d35a5c-2654-4a01-89d5-57e530f6c65b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:33.034852 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-99d35a5c-2654-4a01-89d5-57e530f6c65b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:33.042178 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-99d35a5c-2654-4a01-89d5-57e530f6c65b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:33.042929 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-99d35a5c-2654-4a01-89d5-57e530f6c65b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:33.044121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-99d35a5c-2654-4a01-89d5-57e530f6c65b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:33.044756 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-99d35a5c-2654-4a01-89d5-57e530f6c65b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:33.096311 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-99d35a5c-2654-4a01-89d5-57e530f6c65b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Going to try to terminate instance {{(pid=129466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:27:33.222249 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-99d35a5c-2654-4a01-89d5-57e530f6c65b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "DELETE /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 204 len: 0 microversion: 2.1 time: 0.193574 Jun 16 00:27:33.223387 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 121/241] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:27:33 2022] DELETE /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:27:33.235393 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-45f58a7e-6246-478a-8e9d-6b9a8ba3b7b3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:33.236043 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-45f58a7e-6246-478a-8e9d-6b9a8ba3b7b3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:33.277871 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-45f58a7e-6246-478a-8e9d-6b9a8ba3b7b3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:33.280757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-45f58a7e-6246-478a-8e9d-6b9a8ba3b7b3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:33.283001 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-45f58a7e-6246-478a-8e9d-6b9a8ba3b7b3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:33.287879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-45f58a7e-6246-478a-8e9d-6b9a8ba3b7b3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:33.305571 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-564a73a5-e505-4693-92ae-f38e4576841f req-8a730f86-8017-43e2-8039-2a27acf2d566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0940a4aa-71c4-4a96-8106-40dd8b012547", "tag": "24633b83-4728-4103-8fab-2eb65a801405"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:33.318463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-564a73a5-e505-4693-92ae-f38e4576841f req-8a730f86-8017-43e2-8039-2a27acf2d566 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:33.318999 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-564a73a5-e505-4693-92ae-f38e4576841f req-8a730f86-8017-43e2-8039-2a27acf2d566 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:33.334140 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-564a73a5-e505-4693-92ae-f38e4576841f req-8a730f86-8017-43e2-8039-2a27acf2d566 service nova] Creating event network-changed:24633b83-4728-4103-8fab-2eb65a801405 for instance 0940a4aa-71c4-4a96-8106-40dd8b012547 on hv-cinder-84327 Jun 16 00:27:33.342975 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-564a73a5-e505-4693-92ae-f38e4576841f req-8a730f86-8017-43e2-8039-2a27acf2d566 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043450 Jun 16 00:27:33.344534 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 122/242] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:33.703600 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-78bd693e-3679-4ad9-bf36-f35f971ed1e6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:33.704766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-78bd693e-3679-4ad9-bf36-f35f971ed1e6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:33.706881 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-45f58a7e-6246-478a-8e9d-6b9a8ba3b7b3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:33.716989 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78bd693e-3679-4ad9-bf36-f35f971ed1e6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:33.717621 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78bd693e-3679-4ad9-bf36-f35f971ed1e6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:33.718792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-45f58a7e-6246-478a-8e9d-6b9a8ba3b7b3 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1553 microversion: 2.1 time: 0.490184 Jun 16 00:27:33.719377 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 121/243] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:33 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1553 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:33.720114 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78bd693e-3679-4ad9-bf36-f35f971ed1e6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:33.721635 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78bd693e-3679-4ad9-bf36-f35f971ed1e6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:33.760016 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:33.913118 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-30fbd0e9-1066-4e36-929a-23c10ff865c3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:33.913796 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-30fbd0e9-1066-4e36-929a-23c10ff865c3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:33.931086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-30fbd0e9-1066-4e36-929a-23c10ff865c3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:33.936695 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-30fbd0e9-1066-4e36-929a-23c10ff865c3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:33.937747 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-30fbd0e9-1066-4e36-929a-23c10ff865c3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:33.938407 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-30fbd0e9-1066-4e36-929a-23c10ff865c3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:34.052848 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-78bd693e-3679-4ad9-bf36-f35f971ed1e6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:34.062264 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-78bd693e-3679-4ad9-bf36-f35f971ed1e6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.371630 Jun 16 00:27:34.066806 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 123/244] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:33 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:34.189868 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-30fbd0e9-1066-4e36-929a-23c10ff865c3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:34.200941 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-30fbd0e9-1066-4e36-929a-23c10ff865c3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.291605 Jun 16 00:27:34.202825 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 122/245] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:33 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:34.738802 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-95496c26-871c-46d0-8754-8cd40ed9930c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:34.740665 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-95496c26-871c-46d0-8754-8cd40ed9930c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:34.749888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-95496c26-871c-46d0-8754-8cd40ed9930c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:34.751125 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-95496c26-871c-46d0-8754-8cd40ed9930c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:34.752113 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-95496c26-871c-46d0-8754-8cd40ed9930c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:34.752994 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-95496c26-871c-46d0-8754-8cd40ed9930c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:35.016318 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-95496c26-871c-46d0-8754-8cd40ed9930c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:35.033173 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-95496c26-871c-46d0-8754-8cd40ed9930c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1553 microversion: 2.1 time: 0.298584 Jun 16 00:27:35.034616 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 124/246] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:34 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1553 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:35.092827 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d8144706-f376-4bb7-9223-ef6441ca9c43 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:35.094314 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d8144706-f376-4bb7-9223-ef6441ca9c43 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:35.108084 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d8144706-f376-4bb7-9223-ef6441ca9c43 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:35.108879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d8144706-f376-4bb7-9223-ef6441ca9c43 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:35.111805 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d8144706-f376-4bb7-9223-ef6441ca9c43 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:35.112740 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d8144706-f376-4bb7-9223-ef6441ca9c43 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:35.218928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1ab5779c-ea83-44b3-820e-85b1a3060629 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:35.219753 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1ab5779c-ea83-44b3-820e-85b1a3060629 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:35.225752 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1ab5779c-ea83-44b3-820e-85b1a3060629 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:35.226505 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1ab5779c-ea83-44b3-820e-85b1a3060629 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:35.228285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1ab5779c-ea83-44b3-820e-85b1a3060629 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:35.228903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1ab5779c-ea83-44b3-820e-85b1a3060629 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:35.275996 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-d8144706-f376-4bb7-9223-ef6441ca9c43 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:35.285685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d8144706-f376-4bb7-9223-ef6441ca9c43 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.206877 Jun 16 00:27:35.286261 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 123/247] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:35 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:35.386528 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1ab5779c-ea83-44b3-820e-85b1a3060629 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:35.396027 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1ab5779c-ea83-44b3-820e-85b1a3060629 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.181461 Jun 16 00:27:35.397334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 125/248] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:35 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:36.050594 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-489e8348-2707-4503-bba6-45138066ebc0 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:36.051392 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-489e8348-2707-4503-bba6-45138066ebc0 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:36.057806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-489e8348-2707-4503-bba6-45138066ebc0 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:36.058410 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-489e8348-2707-4503-bba6-45138066ebc0 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:36.060133 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-489e8348-2707-4503-bba6-45138066ebc0 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:36.060694 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-489e8348-2707-4503-bba6-45138066ebc0 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:36.196962 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-489e8348-2707-4503-bba6-45138066ebc0 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:36.208273 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-489e8348-2707-4503-bba6-45138066ebc0 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1553 microversion: 2.1 time: 0.161049 Jun 16 00:27:36.208853 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 124/249] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:36 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:36.307528 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9779d8fa-df03-4c6b-8905-1dd7357e8757 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:36.309293 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9779d8fa-df03-4c6b-8905-1dd7357e8757 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:36.320763 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9779d8fa-df03-4c6b-8905-1dd7357e8757 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:36.322307 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9779d8fa-df03-4c6b-8905-1dd7357e8757 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:36.328663 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9779d8fa-df03-4c6b-8905-1dd7357e8757 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:36.329435 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9779d8fa-df03-4c6b-8905-1dd7357e8757 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:36.420090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9d841618-3db0-4dbb-add8-55e73a6021e5 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:36.421134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9d841618-3db0-4dbb-add8-55e73a6021e5 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:36.439806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d841618-3db0-4dbb-add8-55e73a6021e5 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:36.441026 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d841618-3db0-4dbb-add8-55e73a6021e5 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:36.446460 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d841618-3db0-4dbb-add8-55e73a6021e5 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:36.447139 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d841618-3db0-4dbb-add8-55e73a6021e5 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:36.592038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9779d8fa-df03-4c6b-8905-1dd7357e8757 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:36.612461 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9779d8fa-df03-4c6b-8905-1dd7357e8757 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.310232 Jun 16 00:27:36.612461 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 126/250] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:36 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:36.818190 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9d841618-3db0-4dbb-add8-55e73a6021e5 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:36.833048 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9d841618-3db0-4dbb-add8-55e73a6021e5 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.416497 Jun 16 00:27:36.837089 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 125/251] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:36 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:37.218264 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-cfc8d1d2-e6f0-4417-af7d-1b35855bee29 req-519abb26-5fc3-4db6-9268-c18b3ae50cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "432a6bd4-3bb3-4835-aff2-6edcec69a9a0", "tag": "8f1a7700-fbdc-4faa-8489-793add8ea1ac"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:37.225276 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e2981314-f7fb-4c68-b576-29cea3029739 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:37.225884 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e2981314-f7fb-4c68-b576-29cea3029739 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:37.227501 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-cfc8d1d2-e6f0-4417-af7d-1b35855bee29 req-519abb26-5fc3-4db6-9268-c18b3ae50cc1 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:37.228233 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-cfc8d1d2-e6f0-4417-af7d-1b35855bee29 req-519abb26-5fc3-4db6-9268-c18b3ae50cc1 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:37.234285 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e2981314-f7fb-4c68-b576-29cea3029739 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:37.234732 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e2981314-f7fb-4c68-b576-29cea3029739 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:37.235503 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e2981314-f7fb-4c68-b576-29cea3029739 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:37.235959 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e2981314-f7fb-4c68-b576-29cea3029739 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:37.402676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e2981314-f7fb-4c68-b576-29cea3029739 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:37.411988 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e2981314-f7fb-4c68-b576-29cea3029739 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1553 microversion: 2.1 time: 0.190365 Jun 16 00:27:37.413091 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 126/252] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:37 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:37.432926 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-cfc8d1d2-e6f0-4417-af7d-1b35855bee29 req-519abb26-5fc3-4db6-9268-c18b3ae50cc1 service nova] Creating event network-changed:8f1a7700-fbdc-4faa-8489-793add8ea1ac for instance 432a6bd4-3bb3-4835-aff2-6edcec69a9a0 on hv-cinder-84327 Jun 16 00:27:37.440046 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-cfc8d1d2-e6f0-4417-af7d-1b35855bee29 req-519abb26-5fc3-4db6-9268-c18b3ae50cc1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225430 Jun 16 00:27:37.443585 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 127/253] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:37.629960 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1070025b-14b7-4d06-8e11-1add9770ede5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:37.630594 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1070025b-14b7-4d06-8e11-1add9770ede5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:37.637435 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1070025b-14b7-4d06-8e11-1add9770ede5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:37.638188 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1070025b-14b7-4d06-8e11-1add9770ede5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:37.639354 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1070025b-14b7-4d06-8e11-1add9770ede5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:37.640063 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1070025b-14b7-4d06-8e11-1add9770ede5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:37.660114 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=100 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:37.796888 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1070025b-14b7-4d06-8e11-1add9770ede5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:37.805203 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1070025b-14b7-4d06-8e11-1add9770ede5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.181163 Jun 16 00:27:37.805774 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 127/254] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:37 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:37.855357 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-874215b3-a877-4e9b-9d76-04196fde7353 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:37.856476 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-874215b3-a877-4e9b-9d76-04196fde7353 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:37.864944 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-874215b3-a877-4e9b-9d76-04196fde7353 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:37.865402 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-874215b3-a877-4e9b-9d76-04196fde7353 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:37.866191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-874215b3-a877-4e9b-9d76-04196fde7353 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:37.866636 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-874215b3-a877-4e9b-9d76-04196fde7353 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:38.037289 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-874215b3-a877-4e9b-9d76-04196fde7353 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:38.045199 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-874215b3-a877-4e9b-9d76-04196fde7353 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.194961 Jun 16 00:27:38.046044 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 128/255] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:37 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:38.431211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-af2b4843-0e3f-4c83-b481-b3546f181e4c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:38.432415 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-af2b4843-0e3f-4c83-b481-b3546f181e4c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:38.439436 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-af2b4843-0e3f-4c83-b481-b3546f181e4c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:38.440222 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-af2b4843-0e3f-4c83-b481-b3546f181e4c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:38.440967 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-af2b4843-0e3f-4c83-b481-b3546f181e4c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:38.441557 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-af2b4843-0e3f-4c83-b481-b3546f181e4c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:38.822308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-81fb2f8c-4d9c-4bd6-a836-62fd6eca1243 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:38.822918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-81fb2f8c-4d9c-4bd6-a836-62fd6eca1243 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:38.833318 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-81fb2f8c-4d9c-4bd6-a836-62fd6eca1243 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:38.834063 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-81fb2f8c-4d9c-4bd6-a836-62fd6eca1243 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:38.835070 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-81fb2f8c-4d9c-4bd6-a836-62fd6eca1243 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:38.839918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-81fb2f8c-4d9c-4bd6-a836-62fd6eca1243 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:38.899543 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-af2b4843-0e3f-4c83-b481-b3546f181e4c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:38.912558 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-af2b4843-0e3f-4c83-b481-b3546f181e4c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1553 microversion: 2.1 time: 0.485045 Jun 16 00:27:38.922884 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 128/256] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:38 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1553 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:39.063919 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ca090359-bbb9-4a0f-8262-5f597f835ca7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:39.065422 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ca090359-bbb9-4a0f-8262-5f597f835ca7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:39.072534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca090359-bbb9-4a0f-8262-5f597f835ca7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:39.073111 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca090359-bbb9-4a0f-8262-5f597f835ca7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:39.074240 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca090359-bbb9-4a0f-8262-5f597f835ca7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:39.075292 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca090359-bbb9-4a0f-8262-5f597f835ca7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:39.100888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-81fb2f8c-4d9c-4bd6-a836-62fd6eca1243 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:39.111554 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-81fb2f8c-4d9c-4bd6-a836-62fd6eca1243 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1520 microversion: 2.1 time: 0.291952 Jun 16 00:27:39.114330 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 129/257] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:38 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:39.339714 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-75d03988-04d9-48db-ac99-55db9613ea66 req-468fbf1e-81b1-459d-914f-5ded44604012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3", "name": "network-vif-deleted", "tag": "832d8e05-6171-438e-bdb8-0ab9ae6c2efe"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:39.352020 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ca090359-bbb9-4a0f-8262-5f597f835ca7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:39.360685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ca090359-bbb9-4a0f-8262-5f597f835ca7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.300750 Jun 16 00:27:39.361971 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-75d03988-04d9-48db-ac99-55db9613ea66 req-468fbf1e-81b1-459d-914f-5ded44604012 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:39.362609 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-75d03988-04d9-48db-ac99-55db9613ea66 req-468fbf1e-81b1-459d-914f-5ded44604012 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:39.368778 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 129/258] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:39 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:39.388445 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-75d03988-04d9-48db-ac99-55db9613ea66 req-468fbf1e-81b1-459d-914f-5ded44604012 service nova] Creating event network-vif-deleted:832d8e05-6171-438e-bdb8-0ab9ae6c2efe for instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 on hv-cinder-84327 Jun 16 00:27:39.396039 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-75d03988-04d9-48db-ac99-55db9613ea66 req-468fbf1e-81b1-459d-914f-5ded44604012 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062165 Jun 16 00:27:39.397590 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 130/259] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:39.930223 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bb202877-dab4-402d-bbb7-83a5b1d06a87 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:39.931005 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bb202877-dab4-402d-bbb7-83a5b1d06a87 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:39.941174 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb202877-dab4-402d-bbb7-83a5b1d06a87 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:39.941725 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb202877-dab4-402d-bbb7-83a5b1d06a87 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:39.942514 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb202877-dab4-402d-bbb7-83a5b1d06a87 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:39.942947 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb202877-dab4-402d-bbb7-83a5b1d06a87 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:39.972987 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb202877-dab4-402d-bbb7-83a5b1d06a87 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:39.973433 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb202877-dab4-402d-bbb7-83a5b1d06a87 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:39.973878 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-bb202877-dab4-402d-bbb7-83a5b1d06a87 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lazy-loading 'fault' on Instance uuid 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:27:40.024450 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bb202877-dab4-402d-bbb7-83a5b1d06a87 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:40.032909 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bb202877-dab4-402d-bbb7-83a5b1d06a87 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1351 microversion: 2.1 time: 0.107080 Jun 16 00:27:40.033463 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 130/260] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:39 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:40.129520 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7d8b9d69-bb22-4cd3-9b78-88b353fe1007 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:40.130149 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7d8b9d69-bb22-4cd3-9b78-88b353fe1007 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:40.136958 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7d8b9d69-bb22-4cd3-9b78-88b353fe1007 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:40.137414 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7d8b9d69-bb22-4cd3-9b78-88b353fe1007 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:40.138190 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7d8b9d69-bb22-4cd3-9b78-88b353fe1007 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:40.138636 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7d8b9d69-bb22-4cd3-9b78-88b353fe1007 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:40.305224 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7d8b9d69-bb22-4cd3-9b78-88b353fe1007 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:40.313576 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7d8b9d69-bb22-4cd3-9b78-88b353fe1007 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1500 microversion: 2.1 time: 0.188768 Jun 16 00:27:40.314212 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 131/261] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:40 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1500 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:40.336384 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8d9db225-212b-4394-9532-0d2e2b95b1cf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:40.337000 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8d9db225-212b-4394-9532-0d2e2b95b1cf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:40.343195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8d9db225-212b-4394-9532-0d2e2b95b1cf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:40.343880 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8d9db225-212b-4394-9532-0d2e2b95b1cf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:40.344661 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8d9db225-212b-4394-9532-0d2e2b95b1cf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:40.345769 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8d9db225-212b-4394-9532-0d2e2b95b1cf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:40.377115 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9a105be9-785f-42e5-a64e-fba573d6656e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:40.377964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9a105be9-785f-42e5-a64e-fba573d6656e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:40.384512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9a105be9-785f-42e5-a64e-fba573d6656e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:40.385166 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9a105be9-785f-42e5-a64e-fba573d6656e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:40.387311 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9a105be9-785f-42e5-a64e-fba573d6656e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:40.387929 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9a105be9-785f-42e5-a64e-fba573d6656e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:40.441228 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:40.462093 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=6 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:40.591219 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:40.594549 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8d9db225-212b-4394-9532-0d2e2b95b1cf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:40.603858 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8d9db225-212b-4394-9532-0d2e2b95b1cf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1517 microversion: 2.1 time: 0.269580 Jun 16 00:27:40.603858 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 131/262] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:40 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1517 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:40.625723 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9a105be9-785f-42e5-a64e-fba573d6656e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:40.635701 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9a105be9-785f-42e5-a64e-fba573d6656e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.262287 Jun 16 00:27:40.640293 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 132/263] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:40 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:41.049017 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ca391ddb-c5a5-412e-8674-95a0ea27afea tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:41.049623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ca391ddb-c5a5-412e-8674-95a0ea27afea tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:41.055572 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca391ddb-c5a5-412e-8674-95a0ea27afea tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:41.056049 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca391ddb-c5a5-412e-8674-95a0ea27afea tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:41.056903 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca391ddb-c5a5-412e-8674-95a0ea27afea tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:41.057343 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca391ddb-c5a5-412e-8674-95a0ea27afea tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:41.088207 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca391ddb-c5a5-412e-8674-95a0ea27afea tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:41.088647 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca391ddb-c5a5-412e-8674-95a0ea27afea tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:41.089086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-ca391ddb-c5a5-412e-8674-95a0ea27afea tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lazy-loading 'fault' on Instance uuid 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:27:41.131041 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ca391ddb-c5a5-412e-8674-95a0ea27afea tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:41.139882 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ca391ddb-c5a5-412e-8674-95a0ea27afea tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1351 microversion: 2.1 time: 0.094601 Jun 16 00:27:41.140572 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 132/264] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:41 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:41.653883 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a7dfda7a-d6b6-4861-932f-11fa9584aa80 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:41.654422 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a7dfda7a-d6b6-4861-932f-11fa9584aa80 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:41.660897 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a7dfda7a-d6b6-4861-932f-11fa9584aa80 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:41.661335 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a7dfda7a-d6b6-4861-932f-11fa9584aa80 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:41.662159 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a7dfda7a-d6b6-4861-932f-11fa9584aa80 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:41.662589 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a7dfda7a-d6b6-4861-932f-11fa9584aa80 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:41.997634 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a7dfda7a-d6b6-4861-932f-11fa9584aa80 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:42.005708 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a7dfda7a-d6b6-4861-932f-11fa9584aa80 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.356190 Jun 16 00:27:42.006299 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 133/265] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:41 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:42.161154 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4dce6f8f-3d94-4845-bc97-b010fb3b6bd4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:42.161671 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4dce6f8f-3d94-4845-bc97-b010fb3b6bd4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:42.170212 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4dce6f8f-3d94-4845-bc97-b010fb3b6bd4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:42.170478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4dce6f8f-3d94-4845-bc97-b010fb3b6bd4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:42.171256 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4dce6f8f-3d94-4845-bc97-b010fb3b6bd4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:42.171716 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4dce6f8f-3d94-4845-bc97-b010fb3b6bd4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:42.209857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4dce6f8f-3d94-4845-bc97-b010fb3b6bd4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:42.210339 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4dce6f8f-3d94-4845-bc97-b010fb3b6bd4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:42.210783 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-4dce6f8f-3d94-4845-bc97-b010fb3b6bd4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lazy-loading 'fault' on Instance uuid 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:27:42.254819 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4dce6f8f-3d94-4845-bc97-b010fb3b6bd4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:42.263710 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4dce6f8f-3d94-4845-bc97-b010fb3b6bd4 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1351 microversion: 2.1 time: 0.106332 Jun 16 00:27:42.264365 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 133/266] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:42 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:43.025273 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ee003426-a28a-43ef-b897-3b7f7567e6e3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:43.026005 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ee003426-a28a-43ef-b897-3b7f7567e6e3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:43.033949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ee003426-a28a-43ef-b897-3b7f7567e6e3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.034724 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ee003426-a28a-43ef-b897-3b7f7567e6e3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.035840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ee003426-a28a-43ef-b897-3b7f7567e6e3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.036612 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ee003426-a28a-43ef-b897-3b7f7567e6e3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.064201 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1e325e01-4b65-402a-bea4-d949f7515e5b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:43.065304 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1e325e01-4b65-402a-bea4-d949f7515e5b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:43.071463 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1e325e01-4b65-402a-bea4-d949f7515e5b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.072224 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1e325e01-4b65-402a-bea4-d949f7515e5b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.073192 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1e325e01-4b65-402a-bea4-d949f7515e5b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.073828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1e325e01-4b65-402a-bea4-d949f7515e5b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.099455 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-1e325e01-4b65-402a-bea4-d949f7515e5b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lazy-loading 'flavor' on Instance uuid c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:27:43.182847 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1e325e01-4b65-402a-bea4-d949f7515e5b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "POST /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4/action" status: 200 len: 32 microversion: 2.1 time: 0.122731 Jun 16 00:27:43.184275 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 134/267] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:27:43 2022] POST /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4/action => generated 32 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 00:27:43.193304 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-13d87fb4-39bf-4412-b8b7-0827fd26456b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:43.193992 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-13d87fb4-39bf-4412-b8b7-0827fd26456b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:43.198793 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ee003426-a28a-43ef-b897-3b7f7567e6e3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:43.200608 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-13d87fb4-39bf-4412-b8b7-0827fd26456b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.201142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-13d87fb4-39bf-4412-b8b7-0827fd26456b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.202222 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-13d87fb4-39bf-4412-b8b7-0827fd26456b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.202427 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-13d87fb4-39bf-4412-b8b7-0827fd26456b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.221380 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ee003426-a28a-43ef-b897-3b7f7567e6e3 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.199878 Jun 16 00:27:43.221966 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 134/268] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:43 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:43.281253 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-782d06b4-0cbe-4268-8997-fc2f8432f911 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:43.281897 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-782d06b4-0cbe-4268-8997-fc2f8432f911 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:43.288564 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-782d06b4-0cbe-4268-8997-fc2f8432f911 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.289007 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-782d06b4-0cbe-4268-8997-fc2f8432f911 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.290064 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-782d06b4-0cbe-4268-8997-fc2f8432f911 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.290239 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-782d06b4-0cbe-4268-8997-fc2f8432f911 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.322758 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-782d06b4-0cbe-4268-8997-fc2f8432f911 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:43.323026 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-782d06b4-0cbe-4268-8997-fc2f8432f911 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:43.324629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.objects.instance [None req-782d06b4-0cbe-4268-8997-fc2f8432f911 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lazy-loading 'fault' on Instance uuid 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 {{(pid=129466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:27:43.389414 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-782d06b4-0cbe-4268-8997-fc2f8432f911 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '129de9f58bcf4766a7c15e932d5b92ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516387296aef4322926e0ba1389aace0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:43.398030 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-782d06b4-0cbe-4268-8997-fc2f8432f911 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 200 len: 1351 microversion: 2.1 time: 0.121080 Jun 16 00:27:43.398634 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 135/269] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:43 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 1351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:43.400601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-13d87fb4-39bf-4412-b8b7-0827fd26456b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:43.414082 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-13d87fb4-39bf-4412-b8b7-0827fd26456b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.224870 Jun 16 00:27:43.414656 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 135/270] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:43 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:44.238419 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ab8808ef-c552-409e-8ba3-beab7fbb32ab tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:44.239639 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ab8808ef-c552-409e-8ba3-beab7fbb32ab tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:44.249893 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ab8808ef-c552-409e-8ba3-beab7fbb32ab tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:44.250345 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ab8808ef-c552-409e-8ba3-beab7fbb32ab tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:44.251146 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ab8808ef-c552-409e-8ba3-beab7fbb32ab tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:44.251592 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ab8808ef-c552-409e-8ba3-beab7fbb32ab tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:44.415743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2e4791e4-913b-4ea1-b2c9-2063e5531001 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:44.416353 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2e4791e4-913b-4ea1-b2c9-2063e5531001 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:44.423210 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2e4791e4-913b-4ea1-b2c9-2063e5531001 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:44.423698 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2e4791e4-913b-4ea1-b2c9-2063e5531001 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:44.424479 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2e4791e4-913b-4ea1-b2c9-2063e5531001 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:44.425203 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2e4791e4-913b-4ea1-b2c9-2063e5531001 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:44.442313 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-2e4791e4-913b-4ea1-b2c9-2063e5531001 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] HTTP exception thrown: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2e4791e4-913b-4ea1-b2c9-2063e5531001 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Request method failure captured: Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 HTTP/1.1 Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqniq-hefSfyzlH6-khLVvsgg7Dvf9mNOAiGeaEXLEr6xUJBcb5vIMWnGIdEB4c_EZ2JEl9Xtg8rh_hnHn6XjRbZpU668KLVk05uGi5oVo0cBD_fvkvH9Hz9CV81aq_Te-C7e85WQOQQSF19a3dfpZ-kefCxnwLmjAjTRujSP8u3YGlI Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 516387296aef4322926e0ba1389aace0 Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-DeleteServersTestJSON-1209938944 Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:27:44.450702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:27:44.451961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/516387296aef4322926e0ba1389aace0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_516387296aef4322926e0ba1389aace0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/516387296aef4322926e0ba1389aace0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/516387296aef4322926e0ba1389aace0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:27:44.451961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-DeleteServersTestJSON-1209938944 Jun 16 00:27:44.451961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 516387296aef4322926e0ba1389aace0 Jun 16 00:27:44.451961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-DeleteServersTestJSON-1209938944 Jun 16 00:27:44.451961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-DeleteServersTestJSON-1209938944-project Jun 16 00:27:44.451961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:27:44.451961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:27:44.451961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: 129de9f58bcf4766a7c15e932d5b92ff Jun 16 00:27:44.451961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-DeleteServersTestJSON-1209938944-project Jun 16 00:27:44.451961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:27:44.451961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:44.451961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3'} Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:44.452676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:44.453861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:44.454834 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2e4791e4-913b-4ea1-b2c9-2063e5531001 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Returning 404 to user: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:44.454834 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2e4791e4-913b-4ea1-b2c9-2063e5531001 tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 404 len: 111 microversion: 2.1 time: 0.040622 Jun 16 00:27:44.454834 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 136/271] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:44 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:27:44.460321 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ab8808ef-c552-409e-8ba3-beab7fbb32ab tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:44.460917 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9b1a5a8a-2433-4338-89ac-aee9dc022d80 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:44.461766 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9b1a5a8a-2433-4338-89ac-aee9dc022d80 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:44.468722 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9b1a5a8a-2433-4338-89ac-aee9dc022d80 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:44.469502 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9b1a5a8a-2433-4338-89ac-aee9dc022d80 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:44.470445 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9b1a5a8a-2433-4338-89ac-aee9dc022d80 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:44.470624 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ab8808ef-c552-409e-8ba3-beab7fbb32ab tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.235515 Jun 16 00:27:44.471217 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 136/272] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:44 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:44.472011 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9b1a5a8a-2433-4338-89ac-aee9dc022d80 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:44.582802 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-313bab78-e91c-4538-89d3-58991538115e tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:44.585802 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-313bab78-e91c-4538-89d3-58991538115e tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:44.593912 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-313bab78-e91c-4538-89d3-58991538115e tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:44.600715 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-313bab78-e91c-4538-89d3-58991538115e tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:44.601919 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-313bab78-e91c-4538-89d3-58991538115e tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:44.602657 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-313bab78-e91c-4538-89d3-58991538115e tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:44.635133 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-313bab78-e91c-4538-89d3-58991538115e tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] HTTP exception thrown: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:44.685600 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9b1a5a8a-2433-4338-89ac-aee9dc022d80 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:44.695424 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9b1a5a8a-2433-4338-89ac-aee9dc022d80 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.237796 Jun 16 00:27:44.696633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 137/273] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:44 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-313bab78-e91c-4538-89d3-58991538115e tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Request method failure captured: Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3/os-volume_attachments HTTP/1.1 Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqniq-hefSfyzlH6-khLVvsgg7Dvf9mNOAiGeaEXLEr6xUJBcb5vIMWnGIdEB4c_EZ2JEl9Xtg8rh_hnHn6XjRbZpU668KLVk05uGi5oVo0cBD_fvkvH9Hz9CV81aq_Te-C7e85WQOQQSF19a3dfpZ-kefCxnwLmjAjTRujSP8u3YGlI Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 516387296aef4322926e0ba1389aace0 Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-DeleteServersTestJSON-1209938944 Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:27:44.783040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:27:44.784622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/516387296aef4322926e0ba1389aace0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_516387296aef4322926e0ba1389aace0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/516387296aef4322926e0ba1389aace0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/516387296aef4322926e0ba1389aace0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:27:44.784622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-DeleteServersTestJSON-1209938944 Jun 16 00:27:44.784622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 516387296aef4322926e0ba1389aace0 Jun 16 00:27:44.784622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-DeleteServersTestJSON-1209938944 Jun 16 00:27:44.784622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-DeleteServersTestJSON-1209938944-project Jun 16 00:27:44.784622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:27:44.784622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:27:44.784622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: 129de9f58bcf4766a7c15e932d5b92ff Jun 16 00:27:44.784622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-DeleteServersTestJSON-1209938944-project Jun 16 00:27:44.784622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:27:44.784622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:44.784622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'server_id': '349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3'} Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:44.785436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:44.786748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:44.788517 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-313bab78-e91c-4538-89d3-58991538115e tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Returning 404 to user: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:44.789476 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-313bab78-e91c-4538-89d3-58991538115e tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.211069 Jun 16 00:27:44.790308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 137/274] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:27:44 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3/os-volume_attachments => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:27:45.493104 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-cb428e90-58cc-41cc-ac69-d3eb890a3a22 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:45.493769 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-cb428e90-58cc-41cc-ac69-d3eb890a3a22 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:45.512836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cb428e90-58cc-41cc-ac69-d3eb890a3a22 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:45.512836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cb428e90-58cc-41cc-ac69-d3eb890a3a22 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:45.512836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cb428e90-58cc-41cc-ac69-d3eb890a3a22 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:45.512836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cb428e90-58cc-41cc-ac69-d3eb890a3a22 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:45.713093 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-cb428e90-58cc-41cc-ac69-d3eb890a3a22 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:45.715043 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5eeaa7bb-b3a6-4184-802a-ef58309840c0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:45.717331 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5eeaa7bb-b3a6-4184-802a-ef58309840c0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:45.722502 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-cb428e90-58cc-41cc-ac69-d3eb890a3a22 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.234571 Jun 16 00:27:45.723081 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 138/275] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:45 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:45.736396 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5eeaa7bb-b3a6-4184-802a-ef58309840c0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:45.737109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5eeaa7bb-b3a6-4184-802a-ef58309840c0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:45.738110 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5eeaa7bb-b3a6-4184-802a-ef58309840c0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:45.738767 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5eeaa7bb-b3a6-4184-802a-ef58309840c0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:45.897163 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5eeaa7bb-b3a6-4184-802a-ef58309840c0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:45.905349 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5eeaa7bb-b3a6-4184-802a-ef58309840c0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.195159 Jun 16 00:27:45.905905 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 138/276] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:45 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:46.045549 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1af883be-2f98-422b-a7d4-50f3566c117b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:46.046155 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1af883be-2f98-422b-a7d4-50f3566c117b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:46.052383 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1af883be-2f98-422b-a7d4-50f3566c117b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.052861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1af883be-2f98-422b-a7d4-50f3566c117b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.053595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1af883be-2f98-422b-a7d4-50f3566c117b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.054023 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1af883be-2f98-422b-a7d4-50f3566c117b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.068709 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-1af883be-2f98-422b-a7d4-50f3566c117b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] HTTP exception thrown: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1af883be-2f98-422b-a7d4-50f3566c117b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Request method failure captured: Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: DELETE /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 HTTP/1.1 Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqniq-hefSfyzlH6-khLVvsgg7Dvf9mNOAiGeaEXLEr6xUJBcb5vIMWnGIdEB4c_EZ2JEl9Xtg8rh_hnHn6XjRbZpU668KLVk05uGi5oVo0cBD_fvkvH9Hz9CV81aq_Te-C7e85WQOQQSF19a3dfpZ-kefCxnwLmjAjTRujSP8u3YGlI Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 516387296aef4322926e0ba1389aace0 Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-DeleteServersTestJSON-1209938944 Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:27:46.070563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:27:46.072295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/516387296aef4322926e0ba1389aace0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_516387296aef4322926e0ba1389aace0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/516387296aef4322926e0ba1389aace0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/516387296aef4322926e0ba1389aace0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:27:46.072295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-DeleteServersTestJSON-1209938944 Jun 16 00:27:46.072295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 516387296aef4322926e0ba1389aace0 Jun 16 00:27:46.072295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-DeleteServersTestJSON-1209938944 Jun 16 00:27:46.072295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-DeleteServersTestJSON-1209938944-project Jun 16 00:27:46.072295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:27:46.072295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:27:46.072295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: 129de9f58bcf4766a7c15e932d5b92ff Jun 16 00:27:46.072295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-DeleteServersTestJSON-1209938944-project Jun 16 00:27:46.072295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:27:46.072295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:46.072295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3'} Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:46.077417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:46.078713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:46.080023 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1af883be-2f98-422b-a7d4-50f3566c117b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Returning 404 to user: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:46.080023 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1af883be-2f98-422b-a7d4-50f3566c117b tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "DELETE /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 404 len: 111 microversion: 2.1 time: 0.030605 Jun 16 00:27:46.080023 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 139/277] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:27:46 2022] DELETE /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:27:46.082112 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-442bf4db-ff68-4fb2-b973-a95d3687727c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:46.082719 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-442bf4db-ff68-4fb2-b973-a95d3687727c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] [instance: 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:46.088774 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-442bf4db-ff68-4fb2-b973-a95d3687727c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.089221 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-442bf4db-ff68-4fb2-b973-a95d3687727c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.090009 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-442bf4db-ff68-4fb2-b973-a95d3687727c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.090438 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-442bf4db-ff68-4fb2-b973-a95d3687727c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.103707 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-442bf4db-ff68-4fb2-b973-a95d3687727c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] HTTP exception thrown: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-442bf4db-ff68-4fb2-b973-a95d3687727c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Request method failure captured: Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 HTTP/1.1 Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqniq-hefSfyzlH6-khLVvsgg7Dvf9mNOAiGeaEXLEr6xUJBcb5vIMWnGIdEB4c_EZ2JEl9Xtg8rh_hnHn6XjRbZpU668KLVk05uGi5oVo0cBD_fvkvH9Hz9CV81aq_Te-C7e85WQOQQSF19a3dfpZ-kefCxnwLmjAjTRujSP8u3YGlI Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 516387296aef4322926e0ba1389aace0 Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-DeleteServersTestJSON-1209938944 Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:27:46.109075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:27:46.110535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/516387296aef4322926e0ba1389aace0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_516387296aef4322926e0ba1389aace0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/516387296aef4322926e0ba1389aace0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/516387296aef4322926e0ba1389aace0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:27:46.110535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-DeleteServersTestJSON-1209938944 Jun 16 00:27:46.110535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 516387296aef4322926e0ba1389aace0 Jun 16 00:27:46.110535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-DeleteServersTestJSON-1209938944 Jun 16 00:27:46.110535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-DeleteServersTestJSON-1209938944-project Jun 16 00:27:46.110535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:27:46.110535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:27:46.110535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: 129de9f58bcf4766a7c15e932d5b92ff Jun 16 00:27:46.110535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-DeleteServersTestJSON-1209938944-project Jun 16 00:27:46.110535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:27:46.110535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:46.110535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3'} Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:46.111320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. Jun 16 00:27:46.112648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:46.113830 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-442bf4db-ff68-4fb2-b973-a95d3687727c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] Returning 404 to user: Instance 349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:46.113830 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-442bf4db-ff68-4fb2-b973-a95d3687727c tempest-DeleteServersTestJSON-1209938944 tempest-DeleteServersTestJSON-1209938944-project] 10.222.0.44 "GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3" status: 404 len: 111 microversion: 2.1 time: 0.032969 Jun 16 00:27:46.114620 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 139/278] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:46 2022] GET /compute/v2.1/servers/349ce2ac-ab8e-47f6-9fb1-a363f5ed3bd3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:27:46.744740 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-cf39d4a3-4bb2-4038-ad3a-ba90328892fa tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:46.746639 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-cf39d4a3-4bb2-4038-ad3a-ba90328892fa tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:46.755199 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cf39d4a3-4bb2-4038-ad3a-ba90328892fa tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.756306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cf39d4a3-4bb2-4038-ad3a-ba90328892fa tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.757517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cf39d4a3-4bb2-4038-ad3a-ba90328892fa tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.758704 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cf39d4a3-4bb2-4038-ad3a-ba90328892fa tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.923032 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-14c185d7-7b8c-4497-a3de-f3e6f196e43d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:46.923647 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-14c185d7-7b8c-4497-a3de-f3e6f196e43d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:46.934190 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-14c185d7-7b8c-4497-a3de-f3e6f196e43d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.935980 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-14c185d7-7b8c-4497-a3de-f3e6f196e43d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:46.937892 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-14c185d7-7b8c-4497-a3de-f3e6f196e43d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:46.938587 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-14c185d7-7b8c-4497-a3de-f3e6f196e43d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:47.056070 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-cf39d4a3-4bb2-4038-ad3a-ba90328892fa tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:47.070473 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-cf39d4a3-4bb2-4038-ad3a-ba90328892fa tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.334406 Jun 16 00:27:47.072081 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 140/279] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:46 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:47.080913 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-df522bbd-dc4e-47cc-92fc-ee6a3ea24795 req-ac81debd-a38b-40d6-9158-76309b0e8ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432a6bd4-3bb3-4835-aff2-6edcec69a9a0", "name": "network-vif-plugged", "status": "completed", "tag": "8f1a7700-fbdc-4faa-8489-793add8ea1ac"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:47.098544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-df522bbd-dc4e-47cc-92fc-ee6a3ea24795 req-ac81debd-a38b-40d6-9158-76309b0e8ae4 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:47.099436 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-df522bbd-dc4e-47cc-92fc-ee6a3ea24795 req-ac81debd-a38b-40d6-9158-76309b0e8ae4 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:47.116954 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-df522bbd-dc4e-47cc-92fc-ee6a3ea24795 req-ac81debd-a38b-40d6-9158-76309b0e8ae4 service nova] Creating event network-vif-plugged:8f1a7700-fbdc-4faa-8489-793add8ea1ac for instance 432a6bd4-3bb3-4835-aff2-6edcec69a9a0 on hv-cinder-84327 Jun 16 00:27:47.123355 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-df522bbd-dc4e-47cc-92fc-ee6a3ea24795 req-ac81debd-a38b-40d6-9158-76309b0e8ae4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049722 Jun 16 00:27:47.124184 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 141/280] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:47.184232 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-14c185d7-7b8c-4497-a3de-f3e6f196e43d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:47.192655 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-14c185d7-7b8c-4497-a3de-f3e6f196e43d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.274095 Jun 16 00:27:47.193478 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 140/281] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:46 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:48.088976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9eda8c70-0fef-4e5b-8784-0274b114b034 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:48.090276 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9eda8c70-0fef-4e5b-8784-0274b114b034 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:48.096472 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9eda8c70-0fef-4e5b-8784-0274b114b034 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:48.096915 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9eda8c70-0fef-4e5b-8784-0274b114b034 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:48.097820 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9eda8c70-0fef-4e5b-8784-0274b114b034 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:48.098418 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9eda8c70-0fef-4e5b-8784-0274b114b034 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:48.210318 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5b0675ce-7667-454f-aca5-964f63769d85 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:48.210951 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5b0675ce-7667-454f-aca5-964f63769d85 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:48.222994 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5b0675ce-7667-454f-aca5-964f63769d85 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:48.223445 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5b0675ce-7667-454f-aca5-964f63769d85 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:48.224256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5b0675ce-7667-454f-aca5-964f63769d85 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:48.224694 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5b0675ce-7667-454f-aca5-964f63769d85 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:48.286881 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9eda8c70-0fef-4e5b-8784-0274b114b034 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:48.299944 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9eda8c70-0fef-4e5b-8784-0274b114b034 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.215319 Jun 16 00:27:48.300710 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 142/282] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:48 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:48.440026 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5b0675ce-7667-454f-aca5-964f63769d85 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:48.448130 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5b0675ce-7667-454f-aca5-964f63769d85 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.241461 Jun 16 00:27:48.458355 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 141/283] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:48 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:49.317215 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-99430b20-daf0-42ed-b4f8-2d5ac2503f92 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:49.317911 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-99430b20-daf0-42ed-b4f8-2d5ac2503f92 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:49.324469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99430b20-daf0-42ed-b4f8-2d5ac2503f92 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:49.325195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99430b20-daf0-42ed-b4f8-2d5ac2503f92 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:49.326208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99430b20-daf0-42ed-b4f8-2d5ac2503f92 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:49.326798 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99430b20-daf0-42ed-b4f8-2d5ac2503f92 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:49.331226 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:49.467399 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ad0e6761-3ff4-4a6b-9e7a-3f3bb8e4f00b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:49.468036 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ad0e6761-3ff4-4a6b-9e7a-3f3bb8e4f00b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:49.474761 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ad0e6761-3ff4-4a6b-9e7a-3f3bb8e4f00b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:49.475215 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ad0e6761-3ff4-4a6b-9e7a-3f3bb8e4f00b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:49.476126 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ad0e6761-3ff4-4a6b-9e7a-3f3bb8e4f00b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:49.476746 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ad0e6761-3ff4-4a6b-9e7a-3f3bb8e4f00b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:49.497210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=100 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:49.754775 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-99430b20-daf0-42ed-b4f8-2d5ac2503f92 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:49.764701 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-99430b20-daf0-42ed-b4f8-2d5ac2503f92 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.450554 Jun 16 00:27:49.765757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 143/284] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:49 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:49.790302 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ad0e6761-3ff4-4a6b-9e7a-3f3bb8e4f00b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:49.810043 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ad0e6761-3ff4-4a6b-9e7a-3f3bb8e4f00b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.346648 Jun 16 00:27:49.810617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 142/285] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:49 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:50.781802 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0ee91a56-2c94-4e5f-872c-039deac25927 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:50.783377 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0ee91a56-2c94-4e5f-872c-039deac25927 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:50.789871 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0ee91a56-2c94-4e5f-872c-039deac25927 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:50.790324 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0ee91a56-2c94-4e5f-872c-039deac25927 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:50.791095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0ee91a56-2c94-4e5f-872c-039deac25927 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:50.791533 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0ee91a56-2c94-4e5f-872c-039deac25927 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:50.826631 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-61748b18-fdf6-4f14-9435-0bcc6f1a6094 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:50.827308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-61748b18-fdf6-4f14-9435-0bcc6f1a6094 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:50.834292 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-61748b18-fdf6-4f14-9435-0bcc6f1a6094 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:50.835001 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-61748b18-fdf6-4f14-9435-0bcc6f1a6094 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:50.838282 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-61748b18-fdf6-4f14-9435-0bcc6f1a6094 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:50.838282 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-61748b18-fdf6-4f14-9435-0bcc6f1a6094 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:50.986075 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0ee91a56-2c94-4e5f-872c-039deac25927 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:50.998323 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0ee91a56-2c94-4e5f-872c-039deac25927 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.220133 Jun 16 00:27:51.008407 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 144/286] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:50 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:51.015380 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-61748b18-fdf6-4f14-9435-0bcc6f1a6094 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:51.022807 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-61748b18-fdf6-4f14-9435-0bcc6f1a6094 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.200302 Jun 16 00:27:51.023543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 143/287] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:50 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:51.353992 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-740aae3a-3a90-4774-b084-ffdb8137bcc7 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Action: 'create', calling method: .version_select at 0x7f95824fec10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1868347092", "metadata": {"Type": "work"}}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-740aae3a-3a90-4774-b084-ffdb8137bcc7 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Request method failure captured: Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 122 Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnkHio0zf3zlYOrB11qhX4mk07ofQiiioqBog-THeLYcONZu7YBPQAquo6fmDdM9hHmAtN-OpulxU7OFxTkCYR4Dkbb6MnpS2JUY96FCZFJzP8lBjl1oy_BywIpwx081bMydgGu1fZ2HiOubQs8HmnxPSa3yQFoU2d61I3ni1GBNpKg Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 74ca7545316d4f52820eab03dc16485e Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:27:51.380278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_74ca7545316d4f52820eab03dc16485e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 74ca7545316d4f52820eab03dc16485e Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-VolumesNegativeTest-1881954949-project Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: f5903d9cec2241aa96107bbe38d9cd92 Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-VolumesNegativeTest-1881954949-project Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1868347092", "metadata": {"Type": "work"}}} Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: Jun 16 00:27:51.381866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1868347092', 'metadata': {'Type': 'work'}}}} Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise error Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:51.382682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 00:27:51.383969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 00:27:51.385051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 00:27:51.385051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.385051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-740aae3a-3a90-4774-b084-ffdb8137bcc7 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:51.385051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-740aae3a-3a90-4774-b084-ffdb8137bcc7 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143374 Jun 16 00:27:51.385051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 145/288] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jun 16 00:27:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:27:51.391675 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b6336517-9027-4bff-bd68-682c56b2b283 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Action: 'create', calling method: .version_select at 0x7f9573f69040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1395526160", "metadata": {"Type": "work"}}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b6336517-9027-4bff-bd68-682c56b2b283 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Request method failure captured: Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 120 Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnkHio0zf3zlYOrB11qhX4mk07ofQiiioqBog-THeLYcONZu7YBPQAquo6fmDdM9hHmAtN-OpulxU7OFxTkCYR4Dkbb6MnpS2JUY96FCZFJzP8lBjl1oy_BywIpwx081bMydgGu1fZ2HiOubQs8HmnxPSa3yQFoU2d61I3ni1GBNpKg Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 74ca7545316d4f52820eab03dc16485e Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:27:51.394978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_74ca7545316d4f52820eab03dc16485e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 74ca7545316d4f52820eab03dc16485e Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-VolumesNegativeTest-1881954949-project Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: f5903d9cec2241aa96107bbe38d9cd92 Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-VolumesNegativeTest-1881954949-project Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1395526160", "metadata": {"Type": "work"}}} Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: Jun 16 00:27:51.396469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1395526160', 'metadata': {'Type': 'work'}}}} Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise error Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi '0' Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:51.397783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 00:27:51.399195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 00:27:51.400606 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 00:27:51.400606 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.400606 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b6336517-9027-4bff-bd68-682c56b2b283 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:51.400606 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b6336517-9027-4bff-bd68-682c56b2b283 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008541 Jun 16 00:27:51.400606 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 144/289] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jun 16 00:27:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:27:51.405943 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2f65229c-ebcf-44ff-bc59-b2aa66120bc7 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Action: 'create', calling method: .version_select at 0x7f9580681790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1066873021", "metadata": {"Type": "work"}}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2f65229c-ebcf-44ff-bc59-b2aa66120bc7 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Request method failure captured: Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 119 Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnkHio0zf3zlYOrB11qhX4mk07ofQiiioqBog-THeLYcONZu7YBPQAquo6fmDdM9hHmAtN-OpulxU7OFxTkCYR4Dkbb6MnpS2JUY96FCZFJzP8lBjl1oy_BywIpwx081bMydgGu1fZ2HiOubQs8HmnxPSa3yQFoU2d61I3ni1GBNpKg Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 74ca7545316d4f52820eab03dc16485e Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:27:51.408232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_74ca7545316d4f52820eab03dc16485e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 74ca7545316d4f52820eab03dc16485e Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-VolumesNegativeTest-1881954949-project Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: f5903d9cec2241aa96107bbe38d9cd92 Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-VolumesNegativeTest-1881954949-project Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1066873021", "metadata": {"Type": "work"}}} Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: Jun 16 00:27:51.409667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1066873021', 'metadata': {'Type': 'work'}}}} Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise error Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi '' Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:51.410806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 00:27:51.412357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 00:27:51.413733 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 00:27:51.413733 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.413733 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2f65229c-ebcf-44ff-bc59-b2aa66120bc7 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:51.413733 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2f65229c-ebcf-44ff-bc59-b2aa66120bc7 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007741 Jun 16 00:27:51.413733 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 146/290] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jun 16 00:27:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 00:27:51.418477 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ce2daf98-db06-4494-9709-e270018517bf tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Calling method '.version_select at 0x7f9573e26d30>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:51.445258 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-ce2daf98-db06-4494-9709-e270018517bf tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] HTTP exception thrown: Volume tempest-invalid-457639575 could not be found. Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ce2daf98-db06-4494-9709-e270018517bf tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Request method failure captured: Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-457639575 HTTP/1.1 Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnkHio0zf3zlYOrB11qhX4mk07ofQiiioqBog-THeLYcONZu7YBPQAquo6fmDdM9hHmAtN-OpulxU7OFxTkCYR4Dkbb6MnpS2JUY96FCZFJzP8lBjl1oy_BywIpwx081bMydgGu1fZ2HiOubQs8HmnxPSa3yQFoU2d61I3ni1GBNpKg Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 74ca7545316d4f52820eab03dc16485e Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:27:51.448136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_74ca7545316d4f52820eab03dc16485e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 74ca7545316d4f52820eab03dc16485e Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-VolumesNegativeTest-1881954949-project Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: f5903d9cec2241aa96107bbe38d9cd92 Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-VolumesNegativeTest-1881954949-project Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Volume tempest-invalid-457639575 could not be found. Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': 'tempest-invalid-457639575'} Jun 16 00:27:51.449560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-457639575 could not be found. (HTTP 404) (Request-ID: req-eceea3c8-3f42-4ba0-bbef-cf8b64cd2512) Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.450467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:27:51.451837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-457639575 could not be found. Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:27:51.453148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-457639575 could not be found. Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-457639575 could not be found. Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ce2daf98-db06-4494-9709-e270018517bf tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Returning 404 to user: Volume tempest-invalid-457639575 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ce2daf98-db06-4494-9709-e270018517bf tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-457639575" status: 404 len: 98 microversion: 2.1 time: 0.035052 Jun 16 00:27:51.454664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 145/291] 10.222.0.44 () {58 vars in 1214 bytes} [Thu Jun 16 00:27:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-457639575 => generated 98 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 00:27:51.459827 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c140e7ab-dadb-4e77-b5c4-7aea9dd71e48 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004793 Jun 16 00:27:51.460305 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 147/292] 10.222.0.44 () {58 vars in 1139 bytes} [Thu Jun 16 00:27:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 00:27:51.469483 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c6bcaad7-b577-4d11-b8a2-9b049072ef69 tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003894 Jun 16 00:27:51.469964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 146/293] 10.222.0.44 () {58 vars in 1136 bytes} [Thu Jun 16 00:27:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 16 00:27:51.478355 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e5655897-2661-4b7a-853e-d246b7b9889d tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Calling method '.version_select at 0x7f9580681ca0>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:51.507154 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-e5655897-2661-4b7a-853e-d246b7b9889d tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] HTTP exception thrown: Volume 46dff38d-127b-41a7-9994-1d6011de543c could not be found. Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e5655897-2661-4b7a-853e-d246b7b9889d tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Request method failure captured: Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: DELETE /compute/v2.1/os-volumes/46dff38d-127b-41a7-9994-1d6011de543c HTTP/1.1 Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnkHio0zf3zlYOrB11qhX4mk07ofQiiioqBog-THeLYcONZu7YBPQAquo6fmDdM9hHmAtN-OpulxU7OFxTkCYR4Dkbb6MnpS2JUY96FCZFJzP8lBjl1oy_BywIpwx081bMydgGu1fZ2HiOubQs8HmnxPSa3yQFoU2d61I3ni1GBNpKg Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 74ca7545316d4f52820eab03dc16485e Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:27:51.509756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_74ca7545316d4f52820eab03dc16485e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 74ca7545316d4f52820eab03dc16485e Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-VolumesNegativeTest-1881954949-project Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: f5903d9cec2241aa96107bbe38d9cd92 Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-VolumesNegativeTest-1881954949-project Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Volume 46dff38d-127b-41a7-9994-1d6011de543c could not be found. Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '46dff38d-127b-41a7-9994-1d6011de543c'} Jun 16 00:27:51.511867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46dff38d-127b-41a7-9994-1d6011de543c could not be found. (HTTP 404) (Request-ID: req-b66340dc-59e9-43e8-8471-bfee0eadecf7) Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.512792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:27:51.514480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46dff38d-127b-41a7-9994-1d6011de543c could not be found. Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 00:27:51.515511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46dff38d-127b-41a7-9994-1d6011de543c could not be found. Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46dff38d-127b-41a7-9994-1d6011de543c could not be found. Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e5655897-2661-4b7a-853e-d246b7b9889d tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Returning 404 to user: Volume 46dff38d-127b-41a7-9994-1d6011de543c could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e5655897-2661-4b7a-853e-d246b7b9889d tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/46dff38d-127b-41a7-9994-1d6011de543c" status: 404 len: 109 microversion: 2.1 time: 0.036860 Jun 16 00:27:51.516560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 148/294] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 16 00:27:51 2022] DELETE /compute/v2.1/os-volumes/46dff38d-127b-41a7-9994-1d6011de543c => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:27:51.523848 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-25539758-7b5f-4537-96ea-3be99863972b tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Calling method '.version_select at 0x7f9573e02940>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:51.560037 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-25539758-7b5f-4537-96ea-3be99863972b tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] HTTP exception thrown: Volume 04dd1d4a-f6b6-4ea2-8714-3ba9c86bb336 could not be found. Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-25539758-7b5f-4537-96ea-3be99863972b tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Request method failure captured: Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/os-volumes/04dd1d4a-f6b6-4ea2-8714-3ba9c86bb336 HTTP/1.1 Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnkHio0zf3zlYOrB11qhX4mk07ofQiiioqBog-THeLYcONZu7YBPQAquo6fmDdM9hHmAtN-OpulxU7OFxTkCYR4Dkbb6MnpS2JUY96FCZFJzP8lBjl1oy_BywIpwx081bMydgGu1fZ2HiOubQs8HmnxPSa3yQFoU2d61I3ni1GBNpKg Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 74ca7545316d4f52820eab03dc16485e Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:27:51.561949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_74ca7545316d4f52820eab03dc16485e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/74ca7545316d4f52820eab03dc16485e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 74ca7545316d4f52820eab03dc16485e Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-VolumesNegativeTest-1881954949 Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-VolumesNegativeTest-1881954949-project Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: f5903d9cec2241aa96107bbe38d9cd92 Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-VolumesNegativeTest-1881954949-project Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Volume 04dd1d4a-f6b6-4ea2-8714-3ba9c86bb336 could not be found. Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '04dd1d4a-f6b6-4ea2-8714-3ba9c86bb336'} Jun 16 00:27:51.563375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04dd1d4a-f6b6-4ea2-8714-3ba9c86bb336 could not be found. (HTTP 404) (Request-ID: req-ff1ce919-f725-4186-86a8-fc07108c16f0) Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.564225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:27:51.565271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04dd1d4a-f6b6-4ea2-8714-3ba9c86bb336 could not be found. Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 00:27:51.566247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04dd1d4a-f6b6-4ea2-8714-3ba9c86bb336 could not be found. Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04dd1d4a-f6b6-4ea2-8714-3ba9c86bb336 could not be found. Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-25539758-7b5f-4537-96ea-3be99863972b tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] Returning 404 to user: Volume 04dd1d4a-f6b6-4ea2-8714-3ba9c86bb336 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-25539758-7b5f-4537-96ea-3be99863972b tempest-VolumesNegativeTest-1881954949 tempest-VolumesNegativeTest-1881954949-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/04dd1d4a-f6b6-4ea2-8714-3ba9c86bb336" status: 404 len: 109 microversion: 2.1 time: 0.044543 Jun 16 00:27:51.567379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 147/295] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jun 16 00:27:51 2022] GET /compute/v2.1/os-volumes/04dd1d4a-f6b6-4ea2-8714-3ba9c86bb336 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:27:52.015557 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4826e9d5-2ffa-4496-acde-29bf8eb3a51b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:52.016331 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4826e9d5-2ffa-4496-acde-29bf8eb3a51b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:52.023390 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4826e9d5-2ffa-4496-acde-29bf8eb3a51b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:52.023861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4826e9d5-2ffa-4496-acde-29bf8eb3a51b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:52.024652 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4826e9d5-2ffa-4496-acde-29bf8eb3a51b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:52.025086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4826e9d5-2ffa-4496-acde-29bf8eb3a51b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:52.041067 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fbb02893-4696-4eb0-bd67-d91cff0d83da tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:52.042240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fbb02893-4696-4eb0-bd67-d91cff0d83da tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:52.048711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fbb02893-4696-4eb0-bd67-d91cff0d83da tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:52.049681 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fbb02893-4696-4eb0-bd67-d91cff0d83da tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:52.051129 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fbb02893-4696-4eb0-bd67-d91cff0d83da tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:52.051645 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fbb02893-4696-4eb0-bd67-d91cff0d83da tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:52.254533 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4826e9d5-2ffa-4496-acde-29bf8eb3a51b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:52.261787 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fbb02893-4696-4eb0-bd67-d91cff0d83da tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:52.274294 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4826e9d5-2ffa-4496-acde-29bf8eb3a51b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.262452 Jun 16 00:27:52.280134 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fbb02893-4696-4eb0-bd67-d91cff0d83da tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.241738 Jun 16 00:27:52.280134 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 148/296] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:52 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:52.280718 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 149/297] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:52 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:53.290800 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ab34c3d8-eb19-40f4-b50d-a39c10685bb8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:53.291415 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ab34c3d8-eb19-40f4-b50d-a39c10685bb8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:53.294589 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ba14f497-ac65-4f72-98b6-4f6c6f971fff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:53.295194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ba14f497-ac65-4f72-98b6-4f6c6f971fff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:53.298740 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ab34c3d8-eb19-40f4-b50d-a39c10685bb8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:53.299253 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ab34c3d8-eb19-40f4-b50d-a39c10685bb8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:53.300053 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ab34c3d8-eb19-40f4-b50d-a39c10685bb8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:53.300710 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ab34c3d8-eb19-40f4-b50d-a39c10685bb8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:53.301267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ba14f497-ac65-4f72-98b6-4f6c6f971fff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:53.301841 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ba14f497-ac65-4f72-98b6-4f6c6f971fff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:53.302997 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ba14f497-ac65-4f72-98b6-4f6c6f971fff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:53.303436 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ba14f497-ac65-4f72-98b6-4f6c6f971fff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:53.504333 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ba14f497-ac65-4f72-98b6-4f6c6f971fff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:53.514985 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ba14f497-ac65-4f72-98b6-4f6c6f971fff tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.224427 Jun 16 00:27:53.515553 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 150/298] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:53 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:53.520316 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ab34c3d8-eb19-40f4-b50d-a39c10685bb8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:53.528100 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ab34c3d8-eb19-40f4-b50d-a39c10685bb8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.241297 Jun 16 00:27:53.528641 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 149/299] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:53 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:54.532061 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b3324d85-5a1f-4eae-ac04-59a4f191ac26 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:54.532665 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b3324d85-5a1f-4eae-ac04-59a4f191ac26 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:54.538913 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b3324d85-5a1f-4eae-ac04-59a4f191ac26 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:54.539365 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b3324d85-5a1f-4eae-ac04-59a4f191ac26 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:54.540170 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b3324d85-5a1f-4eae-ac04-59a4f191ac26 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:54.540606 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b3324d85-5a1f-4eae-ac04-59a4f191ac26 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:54.544956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e77cbfaa-a38c-432c-a2ad-21295de29e7c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:54.545556 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e77cbfaa-a38c-432c-a2ad-21295de29e7c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:54.551943 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e77cbfaa-a38c-432c-a2ad-21295de29e7c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:54.552386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e77cbfaa-a38c-432c-a2ad-21295de29e7c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:54.553143 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e77cbfaa-a38c-432c-a2ad-21295de29e7c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:54.553576 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e77cbfaa-a38c-432c-a2ad-21295de29e7c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:54.740402 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b3324d85-5a1f-4eae-ac04-59a4f191ac26 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:54.744481 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e77cbfaa-a38c-432c-a2ad-21295de29e7c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:54.748037 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b3324d85-5a1f-4eae-ac04-59a4f191ac26 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.219747 Jun 16 00:27:54.748599 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 151/300] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:54 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:54.752135 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e77cbfaa-a38c-432c-a2ad-21295de29e7c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.211459 Jun 16 00:27:54.752678 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 150/301] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:54 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:55.766380 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-41baee97-d806-4328-ae44-9a5d6fcf49bd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:55.766993 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-41baee97-d806-4328-ae44-9a5d6fcf49bd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:55.768537 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0788ead3-1bf5-4372-8f4c-e124eb948038 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:55.769142 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0788ead3-1bf5-4372-8f4c-e124eb948038 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:55.773176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-41baee97-d806-4328-ae44-9a5d6fcf49bd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:55.773625 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-41baee97-d806-4328-ae44-9a5d6fcf49bd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:55.774398 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-41baee97-d806-4328-ae44-9a5d6fcf49bd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:55.774833 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-41baee97-d806-4328-ae44-9a5d6fcf49bd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:55.775409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0788ead3-1bf5-4372-8f4c-e124eb948038 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:55.775882 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0788ead3-1bf5-4372-8f4c-e124eb948038 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:55.776649 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0788ead3-1bf5-4372-8f4c-e124eb948038 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:55.777082 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0788ead3-1bf5-4372-8f4c-e124eb948038 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:55.973194 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0788ead3-1bf5-4372-8f4c-e124eb948038 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:55.974259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-41baee97-d806-4328-ae44-9a5d6fcf49bd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:55.985883 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0788ead3-1bf5-4372-8f4c-e124eb948038 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1314 microversion: 2.1 time: 0.221006 Jun 16 00:27:55.996020 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 151/302] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:55 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:55.996248 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-41baee97-d806-4328-ae44-9a5d6fcf49bd tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.227908 Jun 16 00:27:55.996248 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 152/303] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:55 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:57.003725 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c8ae75cd-8b73-492d-9dd4-838d2c80f9af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:57.004268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c8ae75cd-8b73-492d-9dd4-838d2c80f9af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:57.008363 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-32fac088-f962-497a-8dd3-75f1e529b904 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:57.009006 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-32fac088-f962-497a-8dd3-75f1e529b904 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:57.011445 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c8ae75cd-8b73-492d-9dd4-838d2c80f9af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:57.011911 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c8ae75cd-8b73-492d-9dd4-838d2c80f9af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:57.012670 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c8ae75cd-8b73-492d-9dd4-838d2c80f9af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:57.013099 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c8ae75cd-8b73-492d-9dd4-838d2c80f9af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:57.015803 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-32fac088-f962-497a-8dd3-75f1e529b904 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:57.016256 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-32fac088-f962-497a-8dd3-75f1e529b904 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:57.017024 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-32fac088-f962-497a-8dd3-75f1e529b904 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:57.017457 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-32fac088-f962-497a-8dd3-75f1e529b904 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:57.212246 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c8ae75cd-8b73-492d-9dd4-838d2c80f9af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:57.215947 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-32fac088-f962-497a-8dd3-75f1e529b904 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:57.220668 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c8ae75cd-8b73-492d-9dd4-838d2c80f9af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1499 microversion: 2.1 time: 0.220907 Jun 16 00:27:57.221229 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 152/304] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:56 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1499 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:57.223602 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-32fac088-f962-497a-8dd3-75f1e529b904 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.219020 Jun 16 00:27:57.224173 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 153/305] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:57 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:58.239537 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6e8e7bea-e4d7-44b0-ad2e-f2a232458597 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:58.240208 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-6e8e7bea-e4d7-44b0-ad2e-f2a232458597 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:58.246767 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6e8e7bea-e4d7-44b0-ad2e-f2a232458597 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:58.247217 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6e8e7bea-e4d7-44b0-ad2e-f2a232458597 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:58.248041 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6e8e7bea-e4d7-44b0-ad2e-f2a232458597 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:58.248481 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6e8e7bea-e4d7-44b0-ad2e-f2a232458597 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:58.382881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-6e8e7bea-e4d7-44b0-ad2e-f2a232458597 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:58.391161 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-6e8e7bea-e4d7-44b0-ad2e-f2a232458597 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.155457 Jun 16 00:27:58.392080 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 153/306] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:58 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:59.407653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-eef06d25-284f-42f8-bc7b-ff3e8f452f61 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:59.408196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-eef06d25-284f-42f8-bc7b-ff3e8f452f61 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:27:59.414188 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eef06d25-284f-42f8-bc7b-ff3e8f452f61 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:59.414666 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eef06d25-284f-42f8-bc7b-ff3e8f452f61 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:59.415436 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eef06d25-284f-42f8-bc7b-ff3e8f452f61 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:27:59.415913 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eef06d25-284f-42f8-bc7b-ff3e8f452f61 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:27:59.542178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-eef06d25-284f-42f8-bc7b-ff3e8f452f61 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:27:59.549583 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-eef06d25-284f-42f8-bc7b-ff3e8f452f61 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.145861 Jun 16 00:27:59.550168 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 154/307] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:27:59 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:00.565890 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-54746106-b374-46c1-92ca-7dda3d6d9420 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:00.566496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-54746106-b374-46c1-92ca-7dda3d6d9420 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:00.568903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:00.574130 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-54746106-b374-46c1-92ca-7dda3d6d9420 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:00.574581 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-54746106-b374-46c1-92ca-7dda3d6d9420 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:00.575377 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-54746106-b374-46c1-92ca-7dda3d6d9420 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:00.575876 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-54746106-b374-46c1-92ca-7dda3d6d9420 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:00.701201 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-54746106-b374-46c1-92ca-7dda3d6d9420 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:00.708589 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-54746106-b374-46c1-92ca-7dda3d6d9420 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.146438 Jun 16 00:28:00.709148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 154/308] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:00 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:01.725941 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0065dd1f-c905-48c9-81ee-7045d605e1c3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:01.726545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0065dd1f-c905-48c9-81ee-7045d605e1c3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:01.728534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:01.734305 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0065dd1f-c905-48c9-81ee-7045d605e1c3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:01.734754 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0065dd1f-c905-48c9-81ee-7045d605e1c3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:01.735511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0065dd1f-c905-48c9-81ee-7045d605e1c3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:01.735971 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0065dd1f-c905-48c9-81ee-7045d605e1c3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:01.873401 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0065dd1f-c905-48c9-81ee-7045d605e1c3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:01.880773 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0065dd1f-c905-48c9-81ee-7045d605e1c3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.158722 Jun 16 00:28:01.881336 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 155/309] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:01 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:02.896924 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fd55ddb8-475d-4e64-8581-75d1f23ee01f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:02.897462 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fd55ddb8-475d-4e64-8581-75d1f23ee01f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:02.904027 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fd55ddb8-475d-4e64-8581-75d1f23ee01f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:02.904465 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fd55ddb8-475d-4e64-8581-75d1f23ee01f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:02.905212 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fd55ddb8-475d-4e64-8581-75d1f23ee01f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:02.905639 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fd55ddb8-475d-4e64-8581-75d1f23ee01f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:03.031192 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fd55ddb8-475d-4e64-8581-75d1f23ee01f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:03.038456 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fd55ddb8-475d-4e64-8581-75d1f23ee01f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.145395 Jun 16 00:28:03.039010 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 155/310] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:02 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:03.738397 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-99c793e0-1582-4e42-a1b2-690544e54d7d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:03.738879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-99c793e0-1582-4e42-a1b2-690544e54d7d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:03.744853 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99c793e0-1582-4e42-a1b2-690544e54d7d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:03.745298 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99c793e0-1582-4e42-a1b2-690544e54d7d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:03.746062 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99c793e0-1582-4e42-a1b2-690544e54d7d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:03.746493 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99c793e0-1582-4e42-a1b2-690544e54d7d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:03.771451 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-99c793e0-1582-4e42-a1b2-690544e54d7d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Going to try to terminate instance {{(pid=129465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:28:03.851775 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-99c793e0-1582-4e42-a1b2-690544e54d7d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "DELETE /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 204 len: 0 microversion: 2.1 time: 0.120959 Jun 16 00:28:03.852268 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 156/311] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:28:03 2022] DELETE /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:28:03.860840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c089ae10-f4b2-4d32-b88b-8cc249c2ba29 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:03.861447 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c089ae10-f4b2-4d32-b88b-8cc249c2ba29 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:03.867449 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c089ae10-f4b2-4d32-b88b-8cc249c2ba29 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:03.867922 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c089ae10-f4b2-4d32-b88b-8cc249c2ba29 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:03.868678 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c089ae10-f4b2-4d32-b88b-8cc249c2ba29 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:03.869112 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c089ae10-f4b2-4d32-b88b-8cc249c2ba29 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:03.997899 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c089ae10-f4b2-4d32-b88b-8cc249c2ba29 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:04.005319 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c089ae10-f4b2-4d32-b88b-8cc249c2ba29 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1505 microversion: 2.1 time: 0.148409 Jun 16 00:28:04.005864 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 156/312] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:03 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:04.055861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ca067728-9635-45b1-afc8-e5d94d74c569 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:04.056544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ca067728-9635-45b1-afc8-e5d94d74c569 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:04.062885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca067728-9635-45b1-afc8-e5d94d74c569 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:04.063322 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca067728-9635-45b1-afc8-e5d94d74c569 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:04.064107 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca067728-9635-45b1-afc8-e5d94d74c569 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:04.064535 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca067728-9635-45b1-afc8-e5d94d74c569 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:04.193323 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ca067728-9635-45b1-afc8-e5d94d74c569 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:04.201561 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ca067728-9635-45b1-afc8-e5d94d74c569 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.149857 Jun 16 00:28:04.202114 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 157/313] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:04 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:05.023099 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f3a0abe9-19a9-443a-baa4-0358ba993f37 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:05.023736 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f3a0abe9-19a9-443a-baa4-0358ba993f37 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:05.030946 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f3a0abe9-19a9-443a-baa4-0358ba993f37 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:05.031394 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f3a0abe9-19a9-443a-baa4-0358ba993f37 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:05.032183 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f3a0abe9-19a9-443a-baa4-0358ba993f37 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:05.032624 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f3a0abe9-19a9-443a-baa4-0358ba993f37 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:05.171262 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f3a0abe9-19a9-443a-baa4-0358ba993f37 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:05.178691 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f3a0abe9-19a9-443a-baa4-0358ba993f37 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1505 microversion: 2.1 time: 0.159387 Jun 16 00:28:05.179276 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 157/314] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:05 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:05.218443 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-030c2371-1790-4da6-afda-2fa36bb4dc5a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:05.219493 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-030c2371-1790-4da6-afda-2fa36bb4dc5a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:05.225992 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-030c2371-1790-4da6-afda-2fa36bb4dc5a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:05.226443 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-030c2371-1790-4da6-afda-2fa36bb4dc5a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:05.227216 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-030c2371-1790-4da6-afda-2fa36bb4dc5a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:05.227721 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-030c2371-1790-4da6-afda-2fa36bb4dc5a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:05.356520 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-030c2371-1790-4da6-afda-2fa36bb4dc5a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:05.363866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-030c2371-1790-4da6-afda-2fa36bb4dc5a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.149853 Jun 16 00:28:05.364421 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 158/315] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:05 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:06.195784 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f9c464ad-34bf-468d-857d-e7854e0faa51 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:06.196316 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f9c464ad-34bf-468d-857d-e7854e0faa51 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:06.203267 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f9c464ad-34bf-468d-857d-e7854e0faa51 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:06.203750 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f9c464ad-34bf-468d-857d-e7854e0faa51 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:06.204513 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f9c464ad-34bf-468d-857d-e7854e0faa51 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:06.204946 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f9c464ad-34bf-468d-857d-e7854e0faa51 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:06.332631 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f9c464ad-34bf-468d-857d-e7854e0faa51 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:06.340335 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f9c464ad-34bf-468d-857d-e7854e0faa51 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1505 microversion: 2.1 time: 0.148545 Jun 16 00:28:06.340929 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 158/316] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:06 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:06.381117 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-60a5f4e1-52d6-436f-ac75-5bcf958b03c8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:06.381748 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-60a5f4e1-52d6-436f-ac75-5bcf958b03c8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:06.388492 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60a5f4e1-52d6-436f-ac75-5bcf958b03c8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:06.388941 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60a5f4e1-52d6-436f-ac75-5bcf958b03c8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:06.389742 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60a5f4e1-52d6-436f-ac75-5bcf958b03c8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:06.390136 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60a5f4e1-52d6-436f-ac75-5bcf958b03c8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:06.533098 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-60a5f4e1-52d6-436f-ac75-5bcf958b03c8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:06.541709 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-60a5f4e1-52d6-436f-ac75-5bcf958b03c8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.164690 Jun 16 00:28:06.542307 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 159/317] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:06 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:07.357003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b3583bd9-1d46-4e26-b198-b4bd4f930d07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:07.358157 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b3583bd9-1d46-4e26-b198-b4bd4f930d07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:07.364818 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b3583bd9-1d46-4e26-b198-b4bd4f930d07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:07.365269 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b3583bd9-1d46-4e26-b198-b4bd4f930d07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:07.366111 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b3583bd9-1d46-4e26-b198-b4bd4f930d07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:07.366774 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b3583bd9-1d46-4e26-b198-b4bd4f930d07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:07.515145 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b3583bd9-1d46-4e26-b198-b4bd4f930d07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:07.524505 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b3583bd9-1d46-4e26-b198-b4bd4f930d07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1505 microversion: 2.1 time: 0.171209 Jun 16 00:28:07.525085 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 159/318] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:07 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:07.558813 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-37c26667-75f5-41a7-88f2-3ac82b5781f3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:07.560274 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-37c26667-75f5-41a7-88f2-3ac82b5781f3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:07.566909 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-37c26667-75f5-41a7-88f2-3ac82b5781f3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:07.567406 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-37c26667-75f5-41a7-88f2-3ac82b5781f3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:07.568233 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-37c26667-75f5-41a7-88f2-3ac82b5781f3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:07.568953 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-37c26667-75f5-41a7-88f2-3ac82b5781f3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:07.706287 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-37c26667-75f5-41a7-88f2-3ac82b5781f3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:07.713813 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-37c26667-75f5-41a7-88f2-3ac82b5781f3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.158961 Jun 16 00:28:07.714493 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 160/319] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:07 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:08.542792 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-670e7e01-df41-4df5-9c29-e0418a233be7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:08.543515 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-670e7e01-df41-4df5-9c29-e0418a233be7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:08.554149 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-670e7e01-df41-4df5-9c29-e0418a233be7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:08.554952 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-670e7e01-df41-4df5-9c29-e0418a233be7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:08.556167 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-670e7e01-df41-4df5-9c29-e0418a233be7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:08.556753 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-670e7e01-df41-4df5-9c29-e0418a233be7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:08.731379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f85c446c-ce19-4991-8daf-f7a56a3284b3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:08.732016 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f85c446c-ce19-4991-8daf-f7a56a3284b3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:08.741840 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f85c446c-ce19-4991-8daf-f7a56a3284b3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:08.742277 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f85c446c-ce19-4991-8daf-f7a56a3284b3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:08.743062 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f85c446c-ce19-4991-8daf-f7a56a3284b3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:08.743499 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f85c446c-ce19-4991-8daf-f7a56a3284b3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:08.748461 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-670e7e01-df41-4df5-9c29-e0418a233be7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:08.758006 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-670e7e01-df41-4df5-9c29-e0418a233be7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 200 len: 1505 microversion: 2.1 time: 0.218984 Jun 16 00:28:08.758573 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 160/320] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:08 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:08.842252 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-e2e068c8-b92f-425e-96d0-0e202ae1c647 req-e16e8f1a-1f38-4353-b4dc-e415abc32c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "432a6bd4-3bb3-4835-aff2-6edcec69a9a0", "name": "network-vif-deleted", "tag": "8f1a7700-fbdc-4faa-8489-793add8ea1ac"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:08.852439 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-e2e068c8-b92f-425e-96d0-0e202ae1c647 req-e16e8f1a-1f38-4353-b4dc-e415abc32c5b service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:08.853443 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-e2e068c8-b92f-425e-96d0-0e202ae1c647 req-e16e8f1a-1f38-4353-b4dc-e415abc32c5b service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:08.867818 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-e2e068c8-b92f-425e-96d0-0e202ae1c647 req-e16e8f1a-1f38-4353-b4dc-e415abc32c5b service nova] Creating event network-vif-deleted:8f1a7700-fbdc-4faa-8489-793add8ea1ac for instance 432a6bd4-3bb3-4835-aff2-6edcec69a9a0 on hv-cinder-84327 Jun 16 00:28:08.874054 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-e2e068c8-b92f-425e-96d0-0e202ae1c647 req-e16e8f1a-1f38-4353-b4dc-e415abc32c5b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035508 Jun 16 00:28:08.874691 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 161/321] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:28:08.937871 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f85c446c-ce19-4991-8daf-f7a56a3284b3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:08.945312 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f85c446c-ce19-4991-8daf-f7a56a3284b3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.217693 Jun 16 00:28:08.946209 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 161/322] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:08 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:09.781813 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-989acc51-beaa-42a0-a093-aeb2887c96f4 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:09.783174 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-989acc51-beaa-42a0-a093-aeb2887c96f4 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: 432a6bd4-3bb3-4835-aff2-6edcec69a9a0] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:09.796947 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-989acc51-beaa-42a0-a093-aeb2887c96f4 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:09.798174 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-989acc51-beaa-42a0-a093-aeb2887c96f4 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:09.799101 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-989acc51-beaa-42a0-a093-aeb2887c96f4 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:09.799986 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-989acc51-beaa-42a0-a093-aeb2887c96f4 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:09.817759 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-989acc51-beaa-42a0-a093-aeb2887c96f4 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] HTTP exception thrown: Instance 432a6bd4-3bb3-4835-aff2-6edcec69a9a0 could not be found. Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-989acc51-beaa-42a0-a093-aeb2887c96f4 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Request method failure captured: Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 HTTP/1.1 Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnjvRiidwmx8bLSB-OCMU8s1Ae73ubMysbiu1yzRqQaLK_Hx5jXAXWmFzl9D0u8qE6gUj67xjrPHjVPLxbOGGU_c02b9RghutnF5Ubh9caySEcE_IT_i2aw_m0mYDkgP6Zxq7i64-g4WEwAUpnDn01x4Dh1sxorwwgLmLxpfm4Laxuc Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 572e79ce0a7c49b784aa301e367a176b Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-VolumesActionsTest-1763182756 Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:28:09.819523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:28:09.821305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/572e79ce0a7c49b784aa301e367a176b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_572e79ce0a7c49b784aa301e367a176b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/572e79ce0a7c49b784aa301e367a176b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/572e79ce0a7c49b784aa301e367a176b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:28:09.821305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-VolumesActionsTest-1763182756 Jun 16 00:28:09.821305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 572e79ce0a7c49b784aa301e367a176b Jun 16 00:28:09.821305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-VolumesActionsTest-1763182756 Jun 16 00:28:09.821305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-VolumesActionsTest-1763182756-project Jun 16 00:28:09.821305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:28:09.821305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:28:09.821305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: 4cca20d97f474e52bf6581a6a8c57670 Jun 16 00:28:09.821305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-VolumesActionsTest-1763182756-project Jun 16 00:28:09.821305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:28:09.821305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance 432a6bd4-3bb3-4835-aff2-6edcec69a9a0 could not be found. Jun 16 00:28:09.821305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '432a6bd4-3bb3-4835-aff2-6edcec69a9a0'} Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 432a6bd4-3bb3-4835-aff2-6edcec69a9a0 could not be found. Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:28:09.822507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 432a6bd4-3bb3-4835-aff2-6edcec69a9a0 could not be found. Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 432a6bd4-3bb3-4835-aff2-6edcec69a9a0 could not be found. Jun 16 00:28:09.824168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:28:09.825822 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-989acc51-beaa-42a0-a093-aeb2887c96f4 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Returning 404 to user: Instance 432a6bd4-3bb3-4835-aff2-6edcec69a9a0 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:28:09.825822 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-989acc51-beaa-42a0-a093-aeb2887c96f4 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0" status: 404 len: 111 microversion: 2.1 time: 0.048486 Jun 16 00:28:09.825822 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 162/323] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:09 2022] GET /compute/v2.1/servers/432a6bd4-3bb3-4835-aff2-6edcec69a9a0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:28:09.934638 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1170466687", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "networks": [{"uuid": "a37abb5e-6a4b-4bf6-9a54-2314698f04e2"}]}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:09.962940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ce3af05f-e906-4090-9010-4ce5c5732071 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:09.963924 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ce3af05f-e906-4090-9010-4ce5c5732071 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:09.973659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ce3af05f-e906-4090-9010-4ce5c5732071 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:09.974230 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ce3af05f-e906-4090-9010-4ce5c5732071 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:09.975350 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ce3af05f-e906-4090-9010-4ce5c5732071 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:09.985147 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ce3af05f-e906-4090-9010-4ce5c5732071 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:10.001735 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] validate_networks() for [('a37abb5e-6a4b-4bf6-9a54-2314698f04e2', None, None, None, None, None)] {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:28:10.217167 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ce3af05f-e906-4090-9010-4ce5c5732071 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:10.229828 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ce3af05f-e906-4090-9010-4ce5c5732071 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1503 microversion: 2.1 time: 0.271021 Jun 16 00:28:10.244840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 163/324] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:09 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:10.252746 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2fc1b740-9f74-4339-b6c6-727094bb3f3e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30a0b1d2-7560-495f-bb5f-52eecd352ee9"}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:10.254898 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2fc1b740-9f74-4339-b6c6-727094bb3f3e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:10.268841 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2fc1b740-9f74-4339-b6c6-727094bb3f3e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:10.269493 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2fc1b740-9f74-4339-b6c6-727094bb3f3e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2fc1b740-9f74-4339-b6c6-727094bb3f3e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:10.271454 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2fc1b740-9f74-4339-b6c6-727094bb3f3e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:10.289036 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=100 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:10.303122 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-2fc1b740-9f74-4339-b6c6-727094bb3f3e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] HTTP exception thrown: Cannot 'attach_volume' instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 while it is in vm_state rescued Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2fc1b740-9f74-4339-b6c6-727094bb3f3e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Request method failure captured: Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: POST /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4/os-volume_attachments HTTP/1.1 Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 74 Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqniiFW-3qlgNwVdz83mtCf1EP3mQusIS9oVM71fN31IAhMvM3vimbmAv9v_7L8qh08N4M0qPQkSSLvw1vueWN6d7oLOTTpqqADq2uYSq6Uqr2TOGUFzua4lWlXwIlOH7P9cN5l04ADufU7_Vn7ZEXu2T4gOY4i-4Tgd3uEbqVYfn_fc Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 3f0f1114473045f899e99736ff9765df Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:28:10.304992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:28:10.306200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f0f1114473045f899e99736ff9765df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f0f1114473045f899e99736ff9765df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f0f1114473045f899e99736ff9765df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f0f1114473045f899e99736ff9765df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:28:10.306200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:28:10.306200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 3f0f1114473045f899e99736ff9765df Jun 16 00:28:10.306200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:28:10.306200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-ServerRescueNegativeTestJSON-1499675376-project Jun 16 00:28:10.306200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:28:10.306200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:28:10.306200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: 8a57c3f4e4d7479c9f301195cd9764cc Jun 16 00:28:10.306200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499675376-project Jun 16 00:28:10.306200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Jun 16 00:28:10.306200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {"volumeAttachment": {"volumeId": "30a0b1d2-7560-495f-bb5f-52eecd352ee9"}} Jun 16 00:28:10.306200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Cannot 'attach_volume' instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 while it is in vm_state rescued Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'server_id': 'c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4', 'body': {'volumeAttachment': {'volumeId': '30a0b1d2-7560-495f-bb5f-52eecd352ee9'}}} Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:28:10.306903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 while it is in vm_state rescued Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:10.308003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:10.309121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:28:10.309121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:28:10.309121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 while it is in vm_state rescued Jun 16 00:28:10.309121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:28:10.310931 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2fc1b740-9f74-4339-b6c6-727094bb3f3e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Returning 409 to user: Cannot 'attach_volume' instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 while it is in vm_state rescued {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:28:10.312050 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2fc1b740-9f74-4339-b6c6-727094bb3f3e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "POST /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064478 Jun 16 00:28:10.312840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 164/325] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:28:10 2022] POST /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 16 00:28:10.321809 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7b89cac1-d2a2-4359-8a29-7af1e8c548d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:10.322624 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7b89cac1-d2a2-4359-8a29-7af1e8c548d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:10.333650 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7b89cac1-d2a2-4359-8a29-7af1e8c548d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:10.334382 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7b89cac1-d2a2-4359-8a29-7af1e8c548d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:10.336116 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7b89cac1-d2a2-4359-8a29-7af1e8c548d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:10.336835 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7b89cac1-d2a2-4359-8a29-7af1e8c548d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:10.437475 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7b89cac1-d2a2-4359-8a29-7af1e8c548d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "POST /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4/action" status: 202 len: 0 microversion: 2.1 time: 0.118510 Jun 16 00:28:10.438464 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 165/326] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:28:10 2022] POST /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:28:10.451770 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6ff70570-f9ae-4675-91e1-f87381dd4f33 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:10.453285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-6ff70570-f9ae-4675-91e1-f87381dd4f33 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:10.461695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6ff70570-f9ae-4675-91e1-f87381dd4f33 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:10.462416 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6ff70570-f9ae-4675-91e1-f87381dd4f33 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:10.463936 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6ff70570-f9ae-4675-91e1-f87381dd4f33 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:10.465962 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6ff70570-f9ae-4675-91e1-f87381dd4f33 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:10.748355 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:28:10.748840 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:28:10.750396 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:28:10.751532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:28:10.753245 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:28:10.789734 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:10.790426 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:10.791417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:10.792101 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:10.814568 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:10.826647 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-6ff70570-f9ae-4675-91e1-f87381dd4f33 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:10.852178 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-6ff70570-f9ae-4675-91e1-f87381dd4f33 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1511 microversion: 2.1 time: 0.394377 Jun 16 00:28:10.864400 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 166/327] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:10 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:10.873784 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Getting quotas for project 572e79ce0a7c49b784aa301e367a176b. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:28:10.886186 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Getting quotas for user 4cca20d97f474e52bf6581a6a8c57670 and project 572e79ce0a7c49b784aa301e367a176b. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:28:10.904103 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:28:10.907732 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:28:10.988498 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b8b910a7-b473-41fe-9a9f-c43e85e36e96 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.058558 Jun 16 00:28:10.989932 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 162/328] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:28:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:28:11.001042 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8d79ae26-a563-4e31-9767-bcc099d2f75a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:11.001649 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8d79ae26-a563-4e31-9767-bcc099d2f75a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:11.086656 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8d79ae26-a563-4e31-9767-bcc099d2f75a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:11.093925 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8d79ae26-a563-4e31-9767-bcc099d2f75a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1214 microversion: 2.1 time: 0.096839 Jun 16 00:28:11.096224 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 167/329] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:10 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:11.873730 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-fbc0e1ee-dba6-4e35-9693-cb3df3494af0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:11.874620 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-fbc0e1ee-dba6-4e35-9693-cb3df3494af0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:11.882787 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fbc0e1ee-dba6-4e35-9693-cb3df3494af0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:11.884336 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fbc0e1ee-dba6-4e35-9693-cb3df3494af0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:11.885467 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fbc0e1ee-dba6-4e35-9693-cb3df3494af0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:11.885900 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fbc0e1ee-dba6-4e35-9693-cb3df3494af0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:12.055646 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fbc0e1ee-dba6-4e35-9693-cb3df3494af0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:12.067016 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-fbc0e1ee-dba6-4e35-9693-cb3df3494af0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1511 microversion: 2.1 time: 0.198744 Jun 16 00:28:12.067941 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 163/330] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:11 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:12.112665 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2236c87d-1d53-47eb-8192-86f729096103 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:12.113266 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2236c87d-1d53-47eb-8192-86f729096103 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:12.126860 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2236c87d-1d53-47eb-8192-86f729096103 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:12.128042 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2236c87d-1d53-47eb-8192-86f729096103 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:12.129031 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2236c87d-1d53-47eb-8192-86f729096103 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:12.129672 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2236c87d-1d53-47eb-8192-86f729096103 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:12.202194 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2236c87d-1d53-47eb-8192-86f729096103 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:12.210177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2236c87d-1d53-47eb-8192-86f729096103 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1266 microversion: 2.1 time: 0.101336 Jun 16 00:28:12.210824 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 168/331] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:12 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:13.085034 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-47a5bc96-b9d6-42d4-b13e-260572fd19a2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:13.085722 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-47a5bc96-b9d6-42d4-b13e-260572fd19a2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:13.092653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-47a5bc96-b9d6-42d4-b13e-260572fd19a2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:13.093125 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-47a5bc96-b9d6-42d4-b13e-260572fd19a2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:13.094129 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-47a5bc96-b9d6-42d4-b13e-260572fd19a2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:13.094526 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-47a5bc96-b9d6-42d4-b13e-260572fd19a2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:13.227311 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d77fdd07-8d81-4d24-861b-f8da3a223976 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:13.228017 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d77fdd07-8d81-4d24-861b-f8da3a223976 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:13.234665 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d77fdd07-8d81-4d24-861b-f8da3a223976 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:13.235121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d77fdd07-8d81-4d24-861b-f8da3a223976 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:13.235925 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d77fdd07-8d81-4d24-861b-f8da3a223976 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:13.236664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d77fdd07-8d81-4d24-861b-f8da3a223976 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:13.243023 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-47a5bc96-b9d6-42d4-b13e-260572fd19a2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:13.250935 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-47a5bc96-b9d6-42d4-b13e-260572fd19a2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1511 microversion: 2.1 time: 0.170275 Jun 16 00:28:13.251828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 164/332] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:13 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:13.303487 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d77fdd07-8d81-4d24-861b-f8da3a223976 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:13.311851 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d77fdd07-8d81-4d24-861b-f8da3a223976 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1266 microversion: 2.1 time: 0.088469 Jun 16 00:28:13.312452 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 169/333] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:13 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:14.268141 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c862c9e9-73e8-4462-999e-a45e127d90d4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:14.268849 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c862c9e9-73e8-4462-999e-a45e127d90d4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:14.275010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c862c9e9-73e8-4462-999e-a45e127d90d4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:14.275448 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c862c9e9-73e8-4462-999e-a45e127d90d4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:14.276265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c862c9e9-73e8-4462-999e-a45e127d90d4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:14.276723 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c862c9e9-73e8-4462-999e-a45e127d90d4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:14.328273 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2065d37f-2d62-4915-845d-63a96a78f85b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:14.328874 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2065d37f-2d62-4915-845d-63a96a78f85b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:14.335417 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2065d37f-2d62-4915-845d-63a96a78f85b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:14.335892 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2065d37f-2d62-4915-845d-63a96a78f85b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:14.336652 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2065d37f-2d62-4915-845d-63a96a78f85b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:14.337142 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2065d37f-2d62-4915-845d-63a96a78f85b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:14.409593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2065d37f-2d62-4915-845d-63a96a78f85b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:14.416921 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2065d37f-2d62-4915-845d-63a96a78f85b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1266 microversion: 2.1 time: 0.092453 Jun 16 00:28:14.417972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 170/334] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:14 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:14.430761 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c862c9e9-73e8-4462-999e-a45e127d90d4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:14.438789 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c862c9e9-73e8-4462-999e-a45e127d90d4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1511 microversion: 2.1 time: 0.174650 Jun 16 00:28:14.439371 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 165/335] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:14 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:15.434049 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-55539209-a7f1-4c17-8acd-97be53fe00c8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:15.434653 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-55539209-a7f1-4c17-8acd-97be53fe00c8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:15.441103 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-55539209-a7f1-4c17-8acd-97be53fe00c8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:15.441544 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-55539209-a7f1-4c17-8acd-97be53fe00c8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:15.442296 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-55539209-a7f1-4c17-8acd-97be53fe00c8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:15.442727 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-55539209-a7f1-4c17-8acd-97be53fe00c8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:15.455506 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3c70089f-e172-42e4-af33-2761ac97e032 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:15.456145 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3c70089f-e172-42e4-af33-2761ac97e032 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:15.462020 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c70089f-e172-42e4-af33-2761ac97e032 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:15.462467 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c70089f-e172-42e4-af33-2761ac97e032 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:15.463232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c70089f-e172-42e4-af33-2761ac97e032 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:15.463687 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c70089f-e172-42e4-af33-2761ac97e032 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:15.504670 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-55539209-a7f1-4c17-8acd-97be53fe00c8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:15.512327 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-55539209-a7f1-4c17-8acd-97be53fe00c8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1266 microversion: 2.1 time: 0.082028 Jun 16 00:28:15.513084 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 171/336] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:15 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:15.596652 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3c70089f-e172-42e4-af33-2761ac97e032 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:15.604062 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3c70089f-e172-42e4-af33-2761ac97e032 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1511 microversion: 2.1 time: 0.152436 Jun 16 00:28:15.604620 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 166/337] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:15 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:16.529281 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a8becfd9-2a9a-49a8-a837-48e4fb335b8e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:16.529883 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a8becfd9-2a9a-49a8-a837-48e4fb335b8e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:16.536290 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a8becfd9-2a9a-49a8-a837-48e4fb335b8e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:16.536731 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a8becfd9-2a9a-49a8-a837-48e4fb335b8e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:16.537482 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a8becfd9-2a9a-49a8-a837-48e4fb335b8e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:16.537912 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a8becfd9-2a9a-49a8-a837-48e4fb335b8e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:16.600955 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a8becfd9-2a9a-49a8-a837-48e4fb335b8e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:16.608365 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a8becfd9-2a9a-49a8-a837-48e4fb335b8e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1266 microversion: 2.1 time: 0.083522 Jun 16 00:28:16.608919 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 172/338] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:16 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:16.621012 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f99bfaca-68c5-4799-9b25-37363327b979 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:16.621609 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f99bfaca-68c5-4799-9b25-37363327b979 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:16.628263 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f99bfaca-68c5-4799-9b25-37363327b979 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:16.628786 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f99bfaca-68c5-4799-9b25-37363327b979 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:16.629630 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f99bfaca-68c5-4799-9b25-37363327b979 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:16.630113 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f99bfaca-68c5-4799-9b25-37363327b979 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:16.757586 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f99bfaca-68c5-4799-9b25-37363327b979 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:16.765702 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f99bfaca-68c5-4799-9b25-37363327b979 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1511 microversion: 2.1 time: 0.148588 Jun 16 00:28:16.766254 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 167/339] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:16 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:17.626150 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-73f07483-8e40-4d24-942e-8de0c9d8a7ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:17.626850 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-73f07483-8e40-4d24-942e-8de0c9d8a7ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:17.633664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-73f07483-8e40-4d24-942e-8de0c9d8a7ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:17.634104 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-73f07483-8e40-4d24-942e-8de0c9d8a7ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:17.635121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-73f07483-8e40-4d24-942e-8de0c9d8a7ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:17.635549 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-73f07483-8e40-4d24-942e-8de0c9d8a7ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:17.694927 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-73f07483-8e40-4d24-942e-8de0c9d8a7ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:17.702682 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-73f07483-8e40-4d24-942e-8de0c9d8a7ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1266 microversion: 2.1 time: 0.080788 Jun 16 00:28:17.703226 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 173/340] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:17 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:17.782230 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c9e5f527-ccfe-4ddf-85ee-62256d666049 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:17.782872 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c9e5f527-ccfe-4ddf-85ee-62256d666049 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:17.789027 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c9e5f527-ccfe-4ddf-85ee-62256d666049 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:17.789475 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c9e5f527-ccfe-4ddf-85ee-62256d666049 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:17.790241 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c9e5f527-ccfe-4ddf-85ee-62256d666049 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:17.790674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c9e5f527-ccfe-4ddf-85ee-62256d666049 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:17.921335 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c9e5f527-ccfe-4ddf-85ee-62256d666049 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:17.929020 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c9e5f527-ccfe-4ddf-85ee-62256d666049 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1511 microversion: 2.1 time: 0.150603 Jun 16 00:28:17.929581 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 168/341] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:17 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:18.719341 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-26935d4e-bbfd-4d19-ad29-ddcf3d53120b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:18.719983 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-26935d4e-bbfd-4d19-ad29-ddcf3d53120b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:18.726546 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-26935d4e-bbfd-4d19-ad29-ddcf3d53120b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:18.726996 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-26935d4e-bbfd-4d19-ad29-ddcf3d53120b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:18.727797 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-26935d4e-bbfd-4d19-ad29-ddcf3d53120b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:18.728242 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-26935d4e-bbfd-4d19-ad29-ddcf3d53120b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:18.792213 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-26935d4e-bbfd-4d19-ad29-ddcf3d53120b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:18.799684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-26935d4e-bbfd-4d19-ad29-ddcf3d53120b tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1266 microversion: 2.1 time: 0.084097 Jun 16 00:28:18.800250 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 174/342] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:18 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:18.946699 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f21963b0-2086-4b00-9a15-ca25f878ecbb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:18.947304 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f21963b0-2086-4b00-9a15-ca25f878ecbb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:18.953832 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f21963b0-2086-4b00-9a15-ca25f878ecbb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:18.954275 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f21963b0-2086-4b00-9a15-ca25f878ecbb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:18.955033 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f21963b0-2086-4b00-9a15-ca25f878ecbb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:18.955468 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f21963b0-2086-4b00-9a15-ca25f878ecbb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:19.106790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f21963b0-2086-4b00-9a15-ca25f878ecbb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:19.114312 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f21963b0-2086-4b00-9a15-ca25f878ecbb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1511 microversion: 2.1 time: 0.171501 Jun 16 00:28:19.114872 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 169/343] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:18 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:19.817853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a55f1e34-08f2-4722-8047-0ae2e70a5461 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:19.819035 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a55f1e34-08f2-4722-8047-0ae2e70a5461 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:19.827246 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a55f1e34-08f2-4722-8047-0ae2e70a5461 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:19.828067 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a55f1e34-08f2-4722-8047-0ae2e70a5461 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:19.829382 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a55f1e34-08f2-4722-8047-0ae2e70a5461 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:19.829970 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a55f1e34-08f2-4722-8047-0ae2e70a5461 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:19.946381 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a55f1e34-08f2-4722-8047-0ae2e70a5461 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:19.954740 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a55f1e34-08f2-4722-8047-0ae2e70a5461 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1272 microversion: 2.1 time: 0.142648 Jun 16 00:28:19.955296 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 175/344] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:19 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:20.131723 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d3b6ecd5-8aeb-4079-b634-4a0e791c0971 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:20.132350 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d3b6ecd5-8aeb-4079-b634-4a0e791c0971 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:20.139341 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d3b6ecd5-8aeb-4079-b634-4a0e791c0971 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:20.139816 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d3b6ecd5-8aeb-4079-b634-4a0e791c0971 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:20.140578 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d3b6ecd5-8aeb-4079-b634-4a0e791c0971 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:20.141005 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d3b6ecd5-8aeb-4079-b634-4a0e791c0971 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:20.291182 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-d3b6ecd5-8aeb-4079-b634-4a0e791c0971 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:20.314540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d3b6ecd5-8aeb-4079-b634-4a0e791c0971 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1517 microversion: 2.1 time: 0.178487 Jun 16 00:28:20.314540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 170/345] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:20 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:20.974139 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fe15e65f-792d-433a-b33d-2427ecee59a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:20.975286 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fe15e65f-792d-433a-b33d-2427ecee59a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:20.996973 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fe15e65f-792d-433a-b33d-2427ecee59a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:20.997901 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fe15e65f-792d-433a-b33d-2427ecee59a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:20.999000 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fe15e65f-792d-433a-b33d-2427ecee59a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:20.999476 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fe15e65f-792d-433a-b33d-2427ecee59a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:21.091923 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:21.137007 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fe15e65f-792d-433a-b33d-2427ecee59a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:21.145859 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fe15e65f-792d-433a-b33d-2427ecee59a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1272 microversion: 2.1 time: 0.176850 Jun 16 00:28:21.146431 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 176/346] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:20 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:21.850301 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ed8ed725-cb7d-4f59-a3f4-724c2204a105 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Action: 'create', calling method: .version_select at 0x7f9580643af0>, body: {"keypair": {"name": "tempest-keypair-351797934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxwKn0sSxCMaJPvajVncEa1OUkSJ6ewRMFDaaHXdGL35uRUy2Okg9qhFIi0GOcjhFGQf8QjN+4jec/6A8mOhS3PAEcf0yuO/qd5Unq/msAN3GU3twLeU63Q8T0LF+x/Xw=="}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:21.866305 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:21.867251 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=6 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:21.892562 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-ed8ed725-cb7d-4f59-a3f4-724c2204a105 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Getting quotas for project 3f0f1114473045f899e99736ff9765df. Resources: {'key_pairs'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:28:21.910265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-ed8ed725-cb7d-4f59-a3f4-724c2204a105 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Getting quotas for user 8a57c3f4e4d7479c9f301195cd9764cc and project 3f0f1114473045f899e99736ff9765df. Resources: {'key_pairs'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:28:21.982728 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ed8ed725-cb7d-4f59-a3f4-724c2204a105 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.140145 Jun 16 00:28:21.983680 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 171/347] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 16 00:28:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:22.164242 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-67c73201-eb95-4f9e-843d-0b4514498d5e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:22.166159 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-67c73201-eb95-4f9e-843d-0b4514498d5e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:22.177045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-67c73201-eb95-4f9e-843d-0b4514498d5e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:22.177768 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-67c73201-eb95-4f9e-843d-0b4514498d5e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:22.180125 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-67c73201-eb95-4f9e-843d-0b4514498d5e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:22.181333 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-67c73201-eb95-4f9e-843d-0b4514498d5e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:22.471158 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-67c73201-eb95-4f9e-843d-0b4514498d5e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:22.501716 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-67c73201-eb95-4f9e-843d-0b4514498d5e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.343076 Jun 16 00:28:22.516327 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 177/348] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:22 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:22.873884 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-ae029830-61d7-4e61-a07d-2d57023c8f73 req-757e0464-8317-44d5-b6a4-490f2289d3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe074b6c-d316-4e61-8478-6c96ecb2dcf9", "tag": "2955b09d-4afa-4de5-ba8a-a412a3b2fd88"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:22.888428 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-ae029830-61d7-4e61-a07d-2d57023c8f73 req-757e0464-8317-44d5-b6a4-490f2289d3b6 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:22.893434 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-ae029830-61d7-4e61-a07d-2d57023c8f73 req-757e0464-8317-44d5-b6a4-490f2289d3b6 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:22.930137 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-ae029830-61d7-4e61-a07d-2d57023c8f73 req-757e0464-8317-44d5-b6a4-490f2289d3b6 service nova] Creating event network-changed:2955b09d-4afa-4de5-ba8a-a412a3b2fd88 for instance fe074b6c-d316-4e61-8478-6c96ecb2dcf9 on hv-cinder-84327 Jun 16 00:28:22.946567 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-ae029830-61d7-4e61-a07d-2d57023c8f73 req-757e0464-8317-44d5-b6a4-490f2289d3b6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076905 Jun 16 00:28:22.949404 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 172/349] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:23.522639 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5b9a0702-4044-4ce1-911a-25919c1d769c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:23.523923 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5b9a0702-4044-4ce1-911a-25919c1d769c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:23.530860 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5b9a0702-4044-4ce1-911a-25919c1d769c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:23.531378 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5b9a0702-4044-4ce1-911a-25919c1d769c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:23.532117 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5b9a0702-4044-4ce1-911a-25919c1d769c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:23.532558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5b9a0702-4044-4ce1-911a-25919c1d769c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:23.798706 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5b9a0702-4044-4ce1-911a-25919c1d769c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:23.806811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5b9a0702-4044-4ce1-911a-25919c1d769c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.287997 Jun 16 00:28:23.808202 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 178/350] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:23 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:24.539213 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1814748236", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cf90d58-ad38-4382-b77e-0ae17155955d"}], "security_groups": [{"name": "tempest-securitygroup--1530832507"}], "key_name": "tempest-keypair-351797934", "user_data": "}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:24.679342 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] validate_networks() for [('3cf90d58-ad38-4382-b77e-0ae17155955d', None, None, None, None, None)] {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:28:24.827802 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-211a16a1-4822-414c-a498-5f7a4b4f2b99 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:24.828181 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-211a16a1-4822-414c-a498-5f7a4b4f2b99 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:24.835537 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-211a16a1-4822-414c-a498-5f7a4b4f2b99 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:24.836296 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-211a16a1-4822-414c-a498-5f7a4b4f2b99 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:24.837037 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-211a16a1-4822-414c-a498-5f7a4b4f2b99 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:24.838227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-211a16a1-4822-414c-a498-5f7a4b4f2b99 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:25.223849 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-211a16a1-4822-414c-a498-5f7a4b4f2b99 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:25.231266 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-211a16a1-4822-414c-a498-5f7a4b4f2b99 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.408270 Jun 16 00:28:25.240347 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 179/351] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:24 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:25.322572 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:28:25.324016 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:28:25.324750 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:28:25.325432 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:28:25.326210 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:28:25.337003 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:25.337285 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:25.338193 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:25.338680 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:25.360176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Getting quotas for project 3f0f1114473045f899e99736ff9765df. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:28:25.366800 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Getting quotas for user 8a57c3f4e4d7479c9f301195cd9764cc and project 3f0f1114473045f899e99736ff9765df. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:28:25.380893 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:28:25.383450 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:28:25.439849 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b4ecaa14-aa6b-4986-898a-20607cd48931 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.905242 Jun 16 00:28:25.441022 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 173/352] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:28:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:28:25.454019 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9f0d79e9-144e-4f4f-8c4f-5b589e62a40f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:25.454546 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9f0d79e9-144e-4f4f-8c4f-5b589e62a40f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:25.557093 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9f0d79e9-144e-4f4f-8c4f-5b589e62a40f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:25.566096 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9f0d79e9-144e-4f4f-8c4f-5b589e62a40f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1245 microversion: 2.1 time: 0.116493 Jun 16 00:28:25.589999 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 180/353] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:25 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1245 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:26.249732 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bcd1ca35-f548-4507-af3a-ad75781533d2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:26.252050 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bcd1ca35-f548-4507-af3a-ad75781533d2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:26.287309 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bcd1ca35-f548-4507-af3a-ad75781533d2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:26.289488 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bcd1ca35-f548-4507-af3a-ad75781533d2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:26.292668 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bcd1ca35-f548-4507-af3a-ad75781533d2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:26.295119 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bcd1ca35-f548-4507-af3a-ad75781533d2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:26.534038 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bcd1ca35-f548-4507-af3a-ad75781533d2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:26.547585 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bcd1ca35-f548-4507-af3a-ad75781533d2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.302500 Jun 16 00:28:26.551976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 174/354] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:26 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:26.598388 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-647e8102-878c-4b33-a106-99f68dd7b848 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:26.599524 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-647e8102-878c-4b33-a106-99f68dd7b848 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:26.615076 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-647e8102-878c-4b33-a106-99f68dd7b848 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:26.616079 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-647e8102-878c-4b33-a106-99f68dd7b848 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:26.618561 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-647e8102-878c-4b33-a106-99f68dd7b848 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:26.619207 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-647e8102-878c-4b33-a106-99f68dd7b848 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:26.730828 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-647e8102-878c-4b33-a106-99f68dd7b848 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:26.739213 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-647e8102-878c-4b33-a106-99f68dd7b848 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1297 microversion: 2.1 time: 0.144654 Jun 16 00:28:26.749754 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 181/355] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:26 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1297 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:27.572551 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2d33d44b-07cc-4dd9-ac95-466c516956c9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:27.575050 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2d33d44b-07cc-4dd9-ac95-466c516956c9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:27.586988 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2d33d44b-07cc-4dd9-ac95-466c516956c9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:27.587643 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2d33d44b-07cc-4dd9-ac95-466c516956c9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:27.588891 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2d33d44b-07cc-4dd9-ac95-466c516956c9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:27.589513 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2d33d44b-07cc-4dd9-ac95-466c516956c9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:27.766246 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d6b1974a-527a-409f-8246-79c01342e446 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:27.767049 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d6b1974a-527a-409f-8246-79c01342e446 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:27.775291 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d6b1974a-527a-409f-8246-79c01342e446 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:27.781386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d6b1974a-527a-409f-8246-79c01342e446 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:27.782320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d6b1974a-527a-409f-8246-79c01342e446 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:27.782762 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d6b1974a-527a-409f-8246-79c01342e446 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:27.809119 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:27.893732 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d6b1974a-527a-409f-8246-79c01342e446 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:27.902563 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d6b1974a-527a-409f-8246-79c01342e446 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1303 microversion: 2.1 time: 0.149452 Jun 16 00:28:27.904312 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 182/356] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:27 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1303 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:27.918347 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2d33d44b-07cc-4dd9-ac95-466c516956c9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:27.936375 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2d33d44b-07cc-4dd9-ac95-466c516956c9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.368325 Jun 16 00:28:27.937008 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 175/357] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:27 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:28.920943 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0f42b65a-7073-4721-bafa-d3132f2228be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:28.921661 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0f42b65a-7073-4721-bafa-d3132f2228be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:28.928154 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0f42b65a-7073-4721-bafa-d3132f2228be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:28.928547 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0f42b65a-7073-4721-bafa-d3132f2228be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:28.929312 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0f42b65a-7073-4721-bafa-d3132f2228be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:28.929749 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0f42b65a-7073-4721-bafa-d3132f2228be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:28.955736 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0bec49a8-1ca6-441c-b6d6-74f3403359ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:28.956475 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0bec49a8-1ca6-441c-b6d6-74f3403359ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:28.964409 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0bec49a8-1ca6-441c-b6d6-74f3403359ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:28.965152 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0bec49a8-1ca6-441c-b6d6-74f3403359ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:28.965946 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0bec49a8-1ca6-441c-b6d6-74f3403359ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:28.966445 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0bec49a8-1ca6-441c-b6d6-74f3403359ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:29.239386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0f42b65a-7073-4721-bafa-d3132f2228be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:29.246930 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0bec49a8-1ca6-441c-b6d6-74f3403359ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:29.247358 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0f42b65a-7073-4721-bafa-d3132f2228be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.330313 Jun 16 00:28:29.247961 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 183/358] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:28 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:29.254601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0bec49a8-1ca6-441c-b6d6-74f3403359ae tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.303710 Jun 16 00:28:29.255417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 176/359] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:28 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:30.267440 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e70f38f1-02cb-4a97-971d-7136f727273c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:30.268686 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e70f38f1-02cb-4a97-971d-7136f727273c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:30.273816 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e2bfaee0-4034-4c63-9108-58de43e70d64 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:30.274546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e2bfaee0-4034-4c63-9108-58de43e70d64 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:30.278111 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e70f38f1-02cb-4a97-971d-7136f727273c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:30.283715 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e70f38f1-02cb-4a97-971d-7136f727273c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:30.284827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e70f38f1-02cb-4a97-971d-7136f727273c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:30.285645 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e70f38f1-02cb-4a97-971d-7136f727273c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:30.287483 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e2bfaee0-4034-4c63-9108-58de43e70d64 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:30.298313 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e2bfaee0-4034-4c63-9108-58de43e70d64 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:30.299586 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e2bfaee0-4034-4c63-9108-58de43e70d64 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:30.300149 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e2bfaee0-4034-4c63-9108-58de43e70d64 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:30.603645 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e70f38f1-02cb-4a97-971d-7136f727273c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:30.618850 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e70f38f1-02cb-4a97-971d-7136f727273c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.357788 Jun 16 00:28:30.625637 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 184/360] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:30 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:30.707321 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e2bfaee0-4034-4c63-9108-58de43e70d64 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:30.723251 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e2bfaee0-4034-4c63-9108-58de43e70d64 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.454785 Jun 16 00:28:30.727897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 177/361] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:30 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:31.646257 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f9de8477-10ee-4a3a-ada7-18c98a14f92b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:31.648970 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f9de8477-10ee-4a3a-ada7-18c98a14f92b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:31.659907 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=66 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:31.661960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f9de8477-10ee-4a3a-ada7-18c98a14f92b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:31.662864 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f9de8477-10ee-4a3a-ada7-18c98a14f92b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:31.663985 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f9de8477-10ee-4a3a-ada7-18c98a14f92b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:31.664594 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f9de8477-10ee-4a3a-ada7-18c98a14f92b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:31.742511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6d2e08df-d947-4286-9ec2-3ba5b28bce03 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:31.743801 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6d2e08df-d947-4286-9ec2-3ba5b28bce03 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:31.756464 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:31.758651 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6d2e08df-d947-4286-9ec2-3ba5b28bce03 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:31.759313 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6d2e08df-d947-4286-9ec2-3ba5b28bce03 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:31.760860 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6d2e08df-d947-4286-9ec2-3ba5b28bce03 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:31.761509 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6d2e08df-d947-4286-9ec2-3ba5b28bce03 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:32.016007 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f9de8477-10ee-4a3a-ada7-18c98a14f92b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:32.030029 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f9de8477-10ee-4a3a-ada7-18c98a14f92b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.390724 Jun 16 00:28:32.034878 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 185/362] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:31 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:32.083179 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6d2e08df-d947-4286-9ec2-3ba5b28bce03 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:32.092595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6d2e08df-d947-4286-9ec2-3ba5b28bce03 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.353928 Jun 16 00:28:32.107995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 178/363] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:31 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:33.047307 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-39d3c886-5b0e-48ec-b586-27471ad03bc9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:33.048611 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-39d3c886-5b0e-48ec-b586-27471ad03bc9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:33.056790 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-39d3c886-5b0e-48ec-b586-27471ad03bc9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:33.057450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-39d3c886-5b0e-48ec-b586-27471ad03bc9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:33.058474 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-39d3c886-5b0e-48ec-b586-27471ad03bc9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:33.059114 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-39d3c886-5b0e-48ec-b586-27471ad03bc9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:33.109966 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-47c9f02e-afeb-443b-8b9b-59dbeb84355f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:33.111214 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-47c9f02e-afeb-443b-8b9b-59dbeb84355f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:33.125991 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-47c9f02e-afeb-443b-8b9b-59dbeb84355f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:33.126363 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-47c9f02e-afeb-443b-8b9b-59dbeb84355f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:33.127158 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-47c9f02e-afeb-443b-8b9b-59dbeb84355f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:33.130328 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-47c9f02e-afeb-443b-8b9b-59dbeb84355f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:33.333681 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-39d3c886-5b0e-48ec-b586-27471ad03bc9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:33.343122 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-39d3c886-5b0e-48ec-b586-27471ad03bc9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.300398 Jun 16 00:28:33.344232 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 186/364] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:33 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:33.371837 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-47c9f02e-afeb-443b-8b9b-59dbeb84355f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:33.381501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-47c9f02e-afeb-443b-8b9b-59dbeb84355f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.275590 Jun 16 00:28:33.383673 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 179/365] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:33 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:34.360665 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e53a9018-77d2-43d4-a13c-2020cf35048c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:34.361456 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e53a9018-77d2-43d4-a13c-2020cf35048c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:34.369585 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e53a9018-77d2-43d4-a13c-2020cf35048c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:34.370115 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e53a9018-77d2-43d4-a13c-2020cf35048c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:34.370946 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e53a9018-77d2-43d4-a13c-2020cf35048c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:34.371577 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e53a9018-77d2-43d4-a13c-2020cf35048c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:34.403113 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9155120e-d911-4160-8fed-608f0b32b5af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:34.404387 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9155120e-d911-4160-8fed-608f0b32b5af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:34.417252 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9155120e-d911-4160-8fed-608f0b32b5af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:34.417921 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9155120e-d911-4160-8fed-608f0b32b5af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:34.419019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9155120e-d911-4160-8fed-608f0b32b5af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:34.419517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9155120e-d911-4160-8fed-608f0b32b5af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:34.626514 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e53a9018-77d2-43d4-a13c-2020cf35048c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:34.638798 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e53a9018-77d2-43d4-a13c-2020cf35048c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.281737 Jun 16 00:28:34.639381 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 187/366] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:34 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:34.647600 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9155120e-d911-4160-8fed-608f0b32b5af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:34.666097 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9155120e-d911-4160-8fed-608f0b32b5af tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.269072 Jun 16 00:28:34.667172 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 180/367] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:34 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:35.656682 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6e917058-e3a9-42c9-a355-011d17b36948 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:35.657320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-6e917058-e3a9-42c9-a355-011d17b36948 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:35.659870 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:35.665439 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6e917058-e3a9-42c9-a355-011d17b36948 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:35.666152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6e917058-e3a9-42c9-a355-011d17b36948 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:35.667138 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6e917058-e3a9-42c9-a355-011d17b36948 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:35.668294 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6e917058-e3a9-42c9-a355-011d17b36948 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:35.682866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8eb0cdc5-b154-4847-a0a9-a15d324406e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:35.685096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8eb0cdc5-b154-4847-a0a9-a15d324406e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:35.687294 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:35.688165 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=10 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:35.711073 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8eb0cdc5-b154-4847-a0a9-a15d324406e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:35.711582 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8eb0cdc5-b154-4847-a0a9-a15d324406e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:35.712577 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8eb0cdc5-b154-4847-a0a9-a15d324406e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:35.713266 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8eb0cdc5-b154-4847-a0a9-a15d324406e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:36.003520 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-6e917058-e3a9-42c9-a355-011d17b36948 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:36.013310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-6e917058-e3a9-42c9-a355-011d17b36948 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.360599 Jun 16 00:28:36.014561 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 188/368] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:35 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:36.053535 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8eb0cdc5-b154-4847-a0a9-a15d324406e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:36.057104 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=100 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:36.064879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8eb0cdc5-b154-4847-a0a9-a15d324406e8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.385964 Jun 16 00:28:36.065465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 181/369] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:35 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:37.032541 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7ae61686-ef91-4f9f-b659-9ec7285a8b31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:37.033909 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7ae61686-ef91-4f9f-b659-9ec7285a8b31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:37.051581 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7ae61686-ef91-4f9f-b659-9ec7285a8b31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:37.052537 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7ae61686-ef91-4f9f-b659-9ec7285a8b31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:37.053518 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7ae61686-ef91-4f9f-b659-9ec7285a8b31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:37.058178 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7ae61686-ef91-4f9f-b659-9ec7285a8b31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:37.082372 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1247f394-a92b-4b21-9ff4-5c7b4fef3499 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:37.082959 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1247f394-a92b-4b21-9ff4-5c7b4fef3499 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:37.091974 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1247f394-a92b-4b21-9ff4-5c7b4fef3499 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:37.092718 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1247f394-a92b-4b21-9ff4-5c7b4fef3499 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:37.093927 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1247f394-a92b-4b21-9ff4-5c7b4fef3499 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:37.095038 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1247f394-a92b-4b21-9ff4-5c7b4fef3499 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:37.293185 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7ae61686-ef91-4f9f-b659-9ec7285a8b31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:37.303864 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7ae61686-ef91-4f9f-b659-9ec7285a8b31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.277395 Jun 16 00:28:37.304442 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 189/370] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:37 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:37.380912 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1247f394-a92b-4b21-9ff4-5c7b4fef3499 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:37.394090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1247f394-a92b-4b21-9ff4-5c7b4fef3499 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.314002 Jun 16 00:28:37.395649 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 182/371] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:37 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:38.321244 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2bf94006-ede7-4775-92dd-75512ac40a31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:38.322594 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2bf94006-ede7-4775-92dd-75512ac40a31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:38.335946 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2bf94006-ede7-4775-92dd-75512ac40a31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:38.342656 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2bf94006-ede7-4775-92dd-75512ac40a31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:38.343543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2bf94006-ede7-4775-92dd-75512ac40a31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:38.345298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2bf94006-ede7-4775-92dd-75512ac40a31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:38.434873 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bf38e009-c906-4337-a30a-3b11b47bf493 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:38.435721 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bf38e009-c906-4337-a30a-3b11b47bf493 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:38.473735 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bf38e009-c906-4337-a30a-3b11b47bf493 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:38.475343 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bf38e009-c906-4337-a30a-3b11b47bf493 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:38.478047 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bf38e009-c906-4337-a30a-3b11b47bf493 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:38.480895 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bf38e009-c906-4337-a30a-3b11b47bf493 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:38.959194 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2bf94006-ede7-4775-92dd-75512ac40a31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:38.973082 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2bf94006-ede7-4775-92dd-75512ac40a31 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.656450 Jun 16 00:28:38.973967 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 190/372] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:38 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:38.985401 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-ca0dc745-6a18-4349-b49c-d2b75a76a128 req-c1d3d33d-18b3-4712-a2f8-1c0d87710ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a2ac88-a177-4fc8-867b-eef87107e914", "tag": "0e361567-aa2b-46e9-a10e-0d979e26890a"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:39.004442 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-ca0dc745-6a18-4349-b49c-d2b75a76a128 req-c1d3d33d-18b3-4712-a2f8-1c0d87710ae2 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:39.004895 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-ca0dc745-6a18-4349-b49c-d2b75a76a128 req-c1d3d33d-18b3-4712-a2f8-1c0d87710ae2 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:39.019553 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-ca0dc745-6a18-4349-b49c-d2b75a76a128 req-c1d3d33d-18b3-4712-a2f8-1c0d87710ae2 service nova] Creating event network-changed:0e361567-aa2b-46e9-a10e-0d979e26890a for instance f4a2ac88-a177-4fc8-867b-eef87107e914 on hv-cinder-84327 Jun 16 00:28:39.027999 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-ca0dc745-6a18-4349-b49c-d2b75a76a128 req-c1d3d33d-18b3-4712-a2f8-1c0d87710ae2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051900 Jun 16 00:28:39.029151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 191/373] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:39.030427 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bf38e009-c906-4337-a30a-3b11b47bf493 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:39.045738 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bf38e009-c906-4337-a30a-3b11b47bf493 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.622685 Jun 16 00:28:39.048216 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 183/374] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:38 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:39.990627 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b97baffa-daf3-435c-9714-aca9174637a9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:39.991322 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b97baffa-daf3-435c-9714-aca9174637a9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:40.005299 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b97baffa-daf3-435c-9714-aca9174637a9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:40.006199 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b97baffa-daf3-435c-9714-aca9174637a9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:40.012771 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b97baffa-daf3-435c-9714-aca9174637a9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:40.013219 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b97baffa-daf3-435c-9714-aca9174637a9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:40.065088 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0a743386-a682-4102-98ea-e92e1bf8b416 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:40.065810 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0a743386-a682-4102-98ea-e92e1bf8b416 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:40.082267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a743386-a682-4102-98ea-e92e1bf8b416 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:40.082797 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a743386-a682-4102-98ea-e92e1bf8b416 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:40.085461 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a743386-a682-4102-98ea-e92e1bf8b416 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:40.085960 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a743386-a682-4102-98ea-e92e1bf8b416 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:40.289659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b97baffa-daf3-435c-9714-aca9174637a9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:40.297999 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b97baffa-daf3-435c-9714-aca9174637a9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.311285 Jun 16 00:28:40.299096 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 192/375] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:39 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:40.331038 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0a743386-a682-4102-98ea-e92e1bf8b416 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:40.339574 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0a743386-a682-4102-98ea-e92e1bf8b416 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.278736 Jun 16 00:28:40.340730 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 184/376] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:40 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:40.978145 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-0615d6c8-afb6-4a1a-b5e8-66d643450e5f req-9b6596fa-2e61-4a17-97db-8d138e5f83c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe074b6c-d316-4e61-8478-6c96ecb2dcf9", "name": "network-vif-plugged", "status": "completed", "tag": "2955b09d-4afa-4de5-ba8a-a412a3b2fd88"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:40.988235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-0615d6c8-afb6-4a1a-b5e8-66d643450e5f req-9b6596fa-2e61-4a17-97db-8d138e5f83c5 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:40.989190 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-0615d6c8-afb6-4a1a-b5e8-66d643450e5f req-9b6596fa-2e61-4a17-97db-8d138e5f83c5 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:41.004976 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-0615d6c8-afb6-4a1a-b5e8-66d643450e5f req-9b6596fa-2e61-4a17-97db-8d138e5f83c5 service nova] Creating event network-vif-plugged:2955b09d-4afa-4de5-ba8a-a412a3b2fd88 for instance fe074b6c-d316-4e61-8478-6c96ecb2dcf9 on hv-cinder-84327 Jun 16 00:28:41.012840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-0615d6c8-afb6-4a1a-b5e8-66d643450e5f req-9b6596fa-2e61-4a17-97db-8d138e5f83c5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038781 Jun 16 00:28:41.014659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 193/377] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:41.316727 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-fd0a599c-88be-4978-b65d-94ae94f3f0db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:41.317951 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-fd0a599c-88be-4978-b65d-94ae94f3f0db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:41.326367 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fd0a599c-88be-4978-b65d-94ae94f3f0db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:41.327128 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fd0a599c-88be-4978-b65d-94ae94f3f0db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:41.327975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fd0a599c-88be-4978-b65d-94ae94f3f0db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:41.328422 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fd0a599c-88be-4978-b65d-94ae94f3f0db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:41.357389 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-aa5dec89-e8b0-4121-914b-686987a81b83 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:41.358407 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-aa5dec89-e8b0-4121-914b-686987a81b83 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:41.365008 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aa5dec89-e8b0-4121-914b-686987a81b83 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:41.365771 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aa5dec89-e8b0-4121-914b-686987a81b83 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:41.366766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aa5dec89-e8b0-4121-914b-686987a81b83 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:41.367406 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aa5dec89-e8b0-4121-914b-686987a81b83 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:41.546448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-aa5dec89-e8b0-4121-914b-686987a81b83 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:41.559193 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-aa5dec89-e8b0-4121-914b-686987a81b83 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.206254 Jun 16 00:28:41.560342 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 194/378] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:41 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:41.565181 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fd0a599c-88be-4978-b65d-94ae94f3f0db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:41.573310 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-fd0a599c-88be-4978-b65d-94ae94f3f0db tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.262118 Jun 16 00:28:41.574127 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 185/379] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:41 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:42.576811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d9463daf-344f-41d6-a0f1-7cc8c6540b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:42.578542 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d9463daf-344f-41d6-a0f1-7cc8c6540b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:42.591847 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7e303b96-ed41-499b-85f6-bea05bd3538b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:42.593068 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7e303b96-ed41-499b-85f6-bea05bd3538b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:42.606407 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d9463daf-344f-41d6-a0f1-7cc8c6540b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:42.606808 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7e303b96-ed41-499b-85f6-bea05bd3538b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:42.607478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7e303b96-ed41-499b-85f6-bea05bd3538b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:42.624892 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7e303b96-ed41-499b-85f6-bea05bd3538b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:42.625155 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d9463daf-344f-41d6-a0f1-7cc8c6540b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:42.626243 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d9463daf-344f-41d6-a0f1-7cc8c6540b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:42.627104 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d9463daf-344f-41d6-a0f1-7cc8c6540b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:42.627471 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7e303b96-ed41-499b-85f6-bea05bd3538b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:42.965783 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7e303b96-ed41-499b-85f6-bea05bd3538b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:42.973810 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7e303b96-ed41-499b-85f6-bea05bd3538b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.387071 Jun 16 00:28:42.984530 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 186/380] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:42 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:42.986755 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d9463daf-344f-41d6-a0f1-7cc8c6540b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:42.996107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d9463daf-344f-41d6-a0f1-7cc8c6540b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.422978 Jun 16 00:28:43.000351 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 195/381] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:42 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:44.003145 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-39054002-306e-4939-92a4-4d76fa8014ac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:44.004429 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-39054002-306e-4939-92a4-4d76fa8014ac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:44.016705 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-39054002-306e-4939-92a4-4d76fa8014ac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:44.016943 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5d09a059-aaae-4d05-9948-6d41a305a35e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:44.017357 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5d09a059-aaae-4d05-9948-6d41a305a35e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:44.018425 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-39054002-306e-4939-92a4-4d76fa8014ac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:44.022174 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-39054002-306e-4939-92a4-4d76fa8014ac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:44.023210 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-39054002-306e-4939-92a4-4d76fa8014ac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:44.029184 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5d09a059-aaae-4d05-9948-6d41a305a35e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:44.029840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5d09a059-aaae-4d05-9948-6d41a305a35e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:44.030800 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5d09a059-aaae-4d05-9948-6d41a305a35e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:44.034447 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5d09a059-aaae-4d05-9948-6d41a305a35e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:44.257095 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5d09a059-aaae-4d05-9948-6d41a305a35e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:44.265307 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5d09a059-aaae-4d05-9948-6d41a305a35e tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.252290 Jun 16 00:28:44.270891 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 196/382] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:44 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:44.297380 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-39054002-306e-4939-92a4-4d76fa8014ac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:44.307967 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-39054002-306e-4939-92a4-4d76fa8014ac tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.308703 Jun 16 00:28:44.309745 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 187/383] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:43 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:45.286728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3529a81d-1c08-4feb-9142-cd9beaba0f5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:45.287429 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-3529a81d-1c08-4feb-9142-cd9beaba0f5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:45.296816 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3529a81d-1c08-4feb-9142-cd9beaba0f5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:45.297214 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3529a81d-1c08-4feb-9142-cd9beaba0f5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:45.298468 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3529a81d-1c08-4feb-9142-cd9beaba0f5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:45.299128 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3529a81d-1c08-4feb-9142-cd9beaba0f5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:45.325423 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4dde3581-d589-4b13-aa08-eda8f9a015be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:45.326591 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4dde3581-d589-4b13-aa08-eda8f9a015be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:45.336763 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4dde3581-d589-4b13-aa08-eda8f9a015be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:45.342508 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4dde3581-d589-4b13-aa08-eda8f9a015be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:45.344478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4dde3581-d589-4b13-aa08-eda8f9a015be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:45.344930 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4dde3581-d589-4b13-aa08-eda8f9a015be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:45.527996 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3529a81d-1c08-4feb-9142-cd9beaba0f5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:45.540175 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3529a81d-1c08-4feb-9142-cd9beaba0f5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.257289 Jun 16 00:28:45.541095 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 197/384] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:45 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:45.595186 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4dde3581-d589-4b13-aa08-eda8f9a015be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:45.605595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4dde3581-d589-4b13-aa08-eda8f9a015be tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.283315 Jun 16 00:28:45.606832 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 188/385] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:45 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:46.346452 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-11c6d471-16dd-492d-8150-c61913551abd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Action: 'create', calling method: .version_select at 0x7f9573deb790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1892271095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7uExqVwfxZWsLKWlmjfiJdrcqXtf3mZ0sS5jH2ziEW0nIiXYMva9I+MU7kixo1O29LzppN+8LSSY9lnIsPW7NdN70ka534XiKURaFRguiovTzEPry1772LYcRRVTq+7Q=="}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:46.361671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-11c6d471-16dd-492d-8150-c61913551abd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Getting quotas for project 4b5ec212032a46aab16a55fde900c916. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:28:46.365480 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-11c6d471-16dd-492d-8150-c61913551abd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Getting quotas for user ac127f66bf2b4432acd34132911d7c0c and project 4b5ec212032a46aab16a55fde900c916. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:28:46.390697 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-11c6d471-16dd-492d-8150-c61913551abd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049113 Jun 16 00:28:46.395649 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 198/386] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 16 00:28:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:46.489400 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1162311909", "imageRef": "68f14177-f221-47df-a434-a9ee6acf69cd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1892271095", "networks": [{"uuid": "f2d24d4c-4203-4cb9-b2e2-75279bdb368d"}]}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:46.538269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] validate_networks() for [('f2d24d4c-4203-4cb9-b2e2-75279bdb368d', None, None, None, None, None)] {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:28:46.556872 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f4950594-b037-4ad4-812f-afa58114b82a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:46.557493 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f4950594-b037-4ad4-812f-afa58114b82a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:46.564116 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4950594-b037-4ad4-812f-afa58114b82a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:46.564655 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4950594-b037-4ad4-812f-afa58114b82a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:46.565619 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4950594-b037-4ad4-812f-afa58114b82a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:46.566057 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4950594-b037-4ad4-812f-afa58114b82a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:46.765936 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f4950594-b037-4ad4-812f-afa58114b82a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:46.774156 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f4950594-b037-4ad4-812f-afa58114b82a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.220765 Jun 16 00:28:46.774870 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 199/387] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:46 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:46.790689 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-731a5069-828a-41df-93ea-01cafc6886f0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:46.791541 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-731a5069-828a-41df-93ea-01cafc6886f0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:46.804708 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-731a5069-828a-41df-93ea-01cafc6886f0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:46.805237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-731a5069-828a-41df-93ea-01cafc6886f0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:46.806088 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-731a5069-828a-41df-93ea-01cafc6886f0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:46.806979 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-731a5069-828a-41df-93ea-01cafc6886f0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:47.043270 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-731a5069-828a-41df-93ea-01cafc6886f0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:47.050917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-731a5069-828a-41df-93ea-01cafc6886f0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.274832 Jun 16 00:28:47.051479 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 200/388] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:46 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:47.072646 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:28:47.073093 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:28:47.073572 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:28:47.074214 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:28:47.074628 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:28:47.084425 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:47.085140 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:47.086118 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:47.086729 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:47.105490 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Getting quotas for project 4b5ec212032a46aab16a55fde900c916. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:28:47.109908 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Getting quotas for user ac127f66bf2b4432acd34132911d7c0c and project 4b5ec212032a46aab16a55fde900c916. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:28:47.121464 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:28:47.123502 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f14177-f221-47df-a434-a9ee6acf69cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:28:47.175505 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b4810ae2-1ebf-49ba-b93b-c6feb02bd37a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685049 Jun 16 00:28:47.175505 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 189/389] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:28:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:28:47.183989 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6292f8ea-bc44-4be5-8e86-6d0d1f4e2c89 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:47.184744 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-6292f8ea-bc44-4be5-8e86-6d0d1f4e2c89 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:47.260821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-6292f8ea-bc44-4be5-8e86-6d0d1f4e2c89 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:47.268857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-6292f8ea-bc44-4be5-8e86-6d0d1f4e2c89 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1259 microversion: 2.1 time: 0.090811 Jun 16 00:28:47.269394 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 201/390] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:47 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1259 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:47.791898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b1b5a357-1ce1-41e6-8561-594b82642200 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:47.792495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b1b5a357-1ce1-41e6-8561-594b82642200 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:47.799771 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b1b5a357-1ce1-41e6-8561-594b82642200 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:47.802562 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b1b5a357-1ce1-41e6-8561-594b82642200 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:47.803001 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b1b5a357-1ce1-41e6-8561-594b82642200 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:47.803440 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b1b5a357-1ce1-41e6-8561-594b82642200 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:47.958135 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b1b5a357-1ce1-41e6-8561-594b82642200 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:47.965586 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b1b5a357-1ce1-41e6-8561-594b82642200 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.177661 Jun 16 00:28:47.966210 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 190/391] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:47 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:48.067831 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b6210c18-175a-4ede-8cce-1d16cbbe5709 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:48.068437 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b6210c18-175a-4ede-8cce-1d16cbbe5709 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:48.076147 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b6210c18-175a-4ede-8cce-1d16cbbe5709 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:48.076473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b6210c18-175a-4ede-8cce-1d16cbbe5709 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:48.077237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b6210c18-175a-4ede-8cce-1d16cbbe5709 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:48.077672 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b6210c18-175a-4ede-8cce-1d16cbbe5709 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:48.093401 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=100 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:48.205957 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b6210c18-175a-4ede-8cce-1d16cbbe5709 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:48.213220 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b6210c18-175a-4ede-8cce-1d16cbbe5709 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.149437 Jun 16 00:28:48.213773 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 202/392] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:48 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:48.286114 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-03dac15f-8548-4a4d-a241-3518c8cd6181 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:48.286717 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-03dac15f-8548-4a4d-a241-3518c8cd6181 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:48.293552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-03dac15f-8548-4a4d-a241-3518c8cd6181 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:48.293997 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-03dac15f-8548-4a4d-a241-3518c8cd6181 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:48.294798 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-03dac15f-8548-4a4d-a241-3518c8cd6181 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:48.295231 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-03dac15f-8548-4a4d-a241-3518c8cd6181 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:48.358659 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-03dac15f-8548-4a4d-a241-3518c8cd6181 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:48.366195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-03dac15f-8548-4a4d-a241-3518c8cd6181 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1255 microversion: 2.1 time: 0.083858 Jun 16 00:28:48.366754 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 191/393] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:48 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1255 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:48.982146 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5bdb805c-92a0-4ad0-b6aa-41b0f66a4a07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:48.982791 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5bdb805c-92a0-4ad0-b6aa-41b0f66a4a07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:48.989467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5bdb805c-92a0-4ad0-b6aa-41b0f66a4a07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:48.989840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5bdb805c-92a0-4ad0-b6aa-41b0f66a4a07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:48.990604 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5bdb805c-92a0-4ad0-b6aa-41b0f66a4a07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:48.991043 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5bdb805c-92a0-4ad0-b6aa-41b0f66a4a07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:49.121145 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5bdb805c-92a0-4ad0-b6aa-41b0f66a4a07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:49.129281 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5bdb805c-92a0-4ad0-b6aa-41b0f66a4a07 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1314 microversion: 2.1 time: 0.150659 Jun 16 00:28:49.130261 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 203/394] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:48 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:49.231875 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-de88e7a9-5c7b-4cd0-9eea-fac561ddfe55 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:49.232481 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-de88e7a9-5c7b-4cd0-9eea-fac561ddfe55 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:49.238926 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-de88e7a9-5c7b-4cd0-9eea-fac561ddfe55 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:49.239381 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-de88e7a9-5c7b-4cd0-9eea-fac561ddfe55 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:49.240231 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-de88e7a9-5c7b-4cd0-9eea-fac561ddfe55 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:49.240616 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-de88e7a9-5c7b-4cd0-9eea-fac561ddfe55 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:49.369425 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-de88e7a9-5c7b-4cd0-9eea-fac561ddfe55 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:49.377724 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-de88e7a9-5c7b-4cd0-9eea-fac561ddfe55 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.151445 Jun 16 00:28:49.378518 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 192/395] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:49 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:49.383688 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3fcb2d46-1bfa-416f-979e-3ca5d8f78dfb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:49.384301 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-3fcb2d46-1bfa-416f-979e-3ca5d8f78dfb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:49.390618 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3fcb2d46-1bfa-416f-979e-3ca5d8f78dfb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:49.391066 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3fcb2d46-1bfa-416f-979e-3ca5d8f78dfb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:49.391867 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3fcb2d46-1bfa-416f-979e-3ca5d8f78dfb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:49.392302 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3fcb2d46-1bfa-416f-979e-3ca5d8f78dfb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:49.460885 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3fcb2d46-1bfa-416f-979e-3ca5d8f78dfb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:49.469906 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3fcb2d46-1bfa-416f-979e-3ca5d8f78dfb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1311 microversion: 2.1 time: 0.090064 Jun 16 00:28:49.470883 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 204/396] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:49 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:50.028572 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-c800f769-2762-4947-9a7a-718070c11572 req-db9ec5f2-9b67-4094-afb3-532842434f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a2ac88-a177-4fc8-867b-eef87107e914", "name": "network-vif-plugged", "status": "completed", "tag": "0e361567-aa2b-46e9-a10e-0d979e26890a"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:50.038308 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-c800f769-2762-4947-9a7a-718070c11572 req-db9ec5f2-9b67-4094-afb3-532842434f6f service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:50.038768 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-c800f769-2762-4947-9a7a-718070c11572 req-db9ec5f2-9b67-4094-afb3-532842434f6f service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:50.051984 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-c800f769-2762-4947-9a7a-718070c11572 req-db9ec5f2-9b67-4094-afb3-532842434f6f service nova] Creating event network-vif-plugged:0e361567-aa2b-46e9-a10e-0d979e26890a for instance f4a2ac88-a177-4fc8-867b-eef87107e914 on hv-cinder-84327 Jun 16 00:28:50.057733 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-c800f769-2762-4947-9a7a-718070c11572 req-db9ec5f2-9b67-4094-afb3-532842434f6f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034060 Jun 16 00:28:50.058649 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 193/397] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:50.147194 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e19b0de6-add9-43f0-863c-41d7c710be41 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:50.147971 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e19b0de6-add9-43f0-863c-41d7c710be41 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:50.156444 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e19b0de6-add9-43f0-863c-41d7c710be41 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:50.156892 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e19b0de6-add9-43f0-863c-41d7c710be41 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:50.157692 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e19b0de6-add9-43f0-863c-41d7c710be41 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:50.158126 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e19b0de6-add9-43f0-863c-41d7c710be41 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:50.287948 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e19b0de6-add9-43f0-863c-41d7c710be41 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:50.297067 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e19b0de6-add9-43f0-863c-41d7c710be41 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1499 microversion: 2.1 time: 0.153852 Jun 16 00:28:50.297796 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 205/398] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:50 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1499 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:50.396660 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-40b31847-dd73-484b-b795-215802f5b59b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:50.397604 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-40b31847-dd73-484b-b795-215802f5b59b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:50.404324 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-40b31847-dd73-484b-b795-215802f5b59b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:50.405007 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-40b31847-dd73-484b-b795-215802f5b59b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:50.406006 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-40b31847-dd73-484b-b795-215802f5b59b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:50.406596 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-40b31847-dd73-484b-b795-215802f5b59b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:50.487103 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6748f68f-a80e-4de3-9c2f-e8813b0678a1 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:50.487800 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-6748f68f-a80e-4de3-9c2f-e8813b0678a1 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:50.493835 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6748f68f-a80e-4de3-9c2f-e8813b0678a1 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:50.494276 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6748f68f-a80e-4de3-9c2f-e8813b0678a1 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:50.495230 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6748f68f-a80e-4de3-9c2f-e8813b0678a1 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:50.495684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6748f68f-a80e-4de3-9c2f-e8813b0678a1 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:50.571319 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-6748f68f-a80e-4de3-9c2f-e8813b0678a1 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:50.597753 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-6748f68f-a80e-4de3-9c2f-e8813b0678a1 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1317 microversion: 2.1 time: 0.115097 Jun 16 00:28:50.599083 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-40b31847-dd73-484b-b795-215802f5b59b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:50.608985 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-40b31847-dd73-484b-b795-215802f5b59b tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.218068 Jun 16 00:28:50.609673 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 206/399] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:50 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1317 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:50.612260 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 194/400] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:50 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:50.987769 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9c01a057-0be1-4205-96f5-ee1334ae3ecd tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:50.989195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9c01a057-0be1-4205-96f5-ee1334ae3ecd tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:51.000125 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9c01a057-0be1-4205-96f5-ee1334ae3ecd tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:51.000844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9c01a057-0be1-4205-96f5-ee1334ae3ecd tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:51.001982 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9c01a057-0be1-4205-96f5-ee1334ae3ecd tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:51.002614 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9c01a057-0be1-4205-96f5-ee1334ae3ecd tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:51.032007 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9c01a057-0be1-4205-96f5-ee1334ae3ecd tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Going to try to terminate instance {{(pid=129466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:28:51.141618 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9c01a057-0be1-4205-96f5-ee1334ae3ecd tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 204 len: 0 microversion: 2.1 time: 0.164550 Jun 16 00:28:51.142579 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 207/401] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:28:50 2022] DELETE /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:28:51.150543 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5f9de7a1-ccc1-4fea-87ac-955ce24d0122 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:51.151462 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5f9de7a1-ccc1-4fea-87ac-955ce24d0122 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:51.158674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5f9de7a1-ccc1-4fea-87ac-955ce24d0122 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:51.159450 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5f9de7a1-ccc1-4fea-87ac-955ce24d0122 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:51.160491 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5f9de7a1-ccc1-4fea-87ac-955ce24d0122 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:51.161137 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5f9de7a1-ccc1-4fea-87ac-955ce24d0122 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:51.306816 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5f9de7a1-ccc1-4fea-87ac-955ce24d0122 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:51.319005 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5f9de7a1-ccc1-4fea-87ac-955ce24d0122 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.172197 Jun 16 00:28:51.321755 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 195/402] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:51 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:51.615582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-66fc0853-cc63-4343-b3a9-884c920755e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:51.616623 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-66fc0853-cc63-4343-b3a9-884c920755e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:51.624020 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-66fc0853-cc63-4343-b3a9-884c920755e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:51.624837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-66fc0853-cc63-4343-b3a9-884c920755e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:51.625627 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-66fc0853-cc63-4343-b3a9-884c920755e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:51.626469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-66fc0853-cc63-4343-b3a9-884c920755e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:51.628409 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6ac61b39-8f0b-4020-8226-79b9c3adbe45 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:51.629732 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6ac61b39-8f0b-4020-8226-79b9c3adbe45 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:51.636204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6ac61b39-8f0b-4020-8226-79b9c3adbe45 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:51.641242 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6ac61b39-8f0b-4020-8226-79b9c3adbe45 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:51.642419 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6ac61b39-8f0b-4020-8226-79b9c3adbe45 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:51.643055 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6ac61b39-8f0b-4020-8226-79b9c3adbe45 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:51.865717 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6ac61b39-8f0b-4020-8226-79b9c3adbe45 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:51.868980 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-66fc0853-cc63-4343-b3a9-884c920755e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:51.877264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6ac61b39-8f0b-4020-8226-79b9c3adbe45 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.254236 Jun 16 00:28:51.878763 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-66fc0853-cc63-4343-b3a9-884c920755e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.267447 Jun 16 00:28:51.888051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 196/403] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:51 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:51.888898 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 208/404] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:51 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:52.338531 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-abf7231e-ab1d-48dd-9b2a-566ef9481950 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:52.339235 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-abf7231e-ab1d-48dd-9b2a-566ef9481950 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:52.346116 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-abf7231e-ab1d-48dd-9b2a-566ef9481950 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:52.346571 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-abf7231e-ab1d-48dd-9b2a-566ef9481950 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:52.347348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-abf7231e-ab1d-48dd-9b2a-566ef9481950 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:52.347813 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-abf7231e-ab1d-48dd-9b2a-566ef9481950 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:52.488017 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-abf7231e-ab1d-48dd-9b2a-566ef9481950 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:52.496656 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-abf7231e-ab1d-48dd-9b2a-566ef9481950 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.161895 Jun 16 00:28:52.497684 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 197/405] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:52 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:52.895758 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-94398e30-bf4d-4382-8ef1-4704d3b4f697 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:52.896426 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8e7ba2bb-c475-45f3-8ccc-73ee904007a4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:52.896426 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8e7ba2bb-c475-45f3-8ccc-73ee904007a4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:52.897886 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-94398e30-bf4d-4382-8ef1-4704d3b4f697 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:52.904006 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8e7ba2bb-c475-45f3-8ccc-73ee904007a4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:52.904453 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8e7ba2bb-c475-45f3-8ccc-73ee904007a4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:52.904789 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-94398e30-bf4d-4382-8ef1-4704d3b4f697 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:52.905240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8e7ba2bb-c475-45f3-8ccc-73ee904007a4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:52.905481 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-94398e30-bf4d-4382-8ef1-4704d3b4f697 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:52.906064 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-94398e30-bf4d-4382-8ef1-4704d3b4f697 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:52.906171 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8e7ba2bb-c475-45f3-8ccc-73ee904007a4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:52.906507 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-94398e30-bf4d-4382-8ef1-4704d3b4f697 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:53.110298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8e7ba2bb-c475-45f3-8ccc-73ee904007a4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:53.114100 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-94398e30-bf4d-4382-8ef1-4704d3b4f697 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:53.119117 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8e7ba2bb-c475-45f3-8ccc-73ee904007a4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.227280 Jun 16 00:28:53.119709 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 209/406] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:52 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:53.123352 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-94398e30-bf4d-4382-8ef1-4704d3b4f697 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.231554 Jun 16 00:28:53.124039 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 198/407] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:52 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:53.514008 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ead20345-280d-4c1b-9f50-b84aadee8a3f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:53.514623 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ead20345-280d-4c1b-9f50-b84aadee8a3f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:53.520648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ead20345-280d-4c1b-9f50-b84aadee8a3f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:53.521104 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ead20345-280d-4c1b-9f50-b84aadee8a3f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:53.521867 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ead20345-280d-4c1b-9f50-b84aadee8a3f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:53.522306 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ead20345-280d-4c1b-9f50-b84aadee8a3f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:53.696858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ead20345-280d-4c1b-9f50-b84aadee8a3f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:53.705644 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ead20345-280d-4c1b-9f50-b84aadee8a3f tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.195716 Jun 16 00:28:53.706306 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 210/408] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:53 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:54.136926 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b0a39f3d-835f-41b1-a474-0be6c2875cce tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:54.137830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b0a39f3d-835f-41b1-a474-0be6c2875cce tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:54.145492 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b0a39f3d-835f-41b1-a474-0be6c2875cce tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:54.146118 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b0a39f3d-835f-41b1-a474-0be6c2875cce tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:54.146413 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-949fe525-1c61-4013-8f3d-281089957807 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:54.147230 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b0a39f3d-835f-41b1-a474-0be6c2875cce tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:54.147871 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-949fe525-1c61-4013-8f3d-281089957807 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:54.148118 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b0a39f3d-835f-41b1-a474-0be6c2875cce tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:54.156462 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-949fe525-1c61-4013-8f3d-281089957807 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:54.157289 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-949fe525-1c61-4013-8f3d-281089957807 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:54.158396 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-949fe525-1c61-4013-8f3d-281089957807 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:54.158992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-949fe525-1c61-4013-8f3d-281089957807 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:54.357399 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b0a39f3d-835f-41b1-a474-0be6c2875cce tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:54.360254 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-949fe525-1c61-4013-8f3d-281089957807 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:54.369394 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=100 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:54.369793 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-949fe525-1c61-4013-8f3d-281089957807 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.228035 Jun 16 00:28:54.381373 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b0a39f3d-835f-41b1-a474-0be6c2875cce tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.243284 Jun 16 00:28:54.381373 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 199/409] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:54 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:54.381849 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 211/410] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:54 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:54.722842 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ab22d2d4-88c5-43b5-8bf6-d90311b3c187 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:54.723454 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ab22d2d4-88c5-43b5-8bf6-d90311b3c187 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:54.729579 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ab22d2d4-88c5-43b5-8bf6-d90311b3c187 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:54.730032 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ab22d2d4-88c5-43b5-8bf6-d90311b3c187 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:54.731321 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ab22d2d4-88c5-43b5-8bf6-d90311b3c187 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:54.731969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ab22d2d4-88c5-43b5-8bf6-d90311b3c187 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:54.881755 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ab22d2d4-88c5-43b5-8bf6-d90311b3c187 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:54.889410 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ab22d2d4-88c5-43b5-8bf6-d90311b3c187 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.170408 Jun 16 00:28:54.889965 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 200/411] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:54 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:55.389333 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e953f175-926a-4f7f-8b76-2371071baf5f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:55.390565 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e953f175-926a-4f7f-8b76-2371071baf5f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:55.395087 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-eb5d4a14-3866-42bb-ac8e-693408f7f7f2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:55.395921 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-eb5d4a14-3866-42bb-ac8e-693408f7f7f2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:55.399305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e953f175-926a-4f7f-8b76-2371071baf5f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:55.400596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e953f175-926a-4f7f-8b76-2371071baf5f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:55.402122 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e953f175-926a-4f7f-8b76-2371071baf5f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:55.402967 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e953f175-926a-4f7f-8b76-2371071baf5f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:55.405439 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eb5d4a14-3866-42bb-ac8e-693408f7f7f2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:55.405965 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eb5d4a14-3866-42bb-ac8e-693408f7f7f2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:55.406816 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eb5d4a14-3866-42bb-ac8e-693408f7f7f2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:55.407511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eb5d4a14-3866-42bb-ac8e-693408f7f7f2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:55.684976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-eb5d4a14-3866-42bb-ac8e-693408f7f7f2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:55.688379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e953f175-926a-4f7f-8b76-2371071baf5f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:55.704697 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e953f175-926a-4f7f-8b76-2371071baf5f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.319587 Jun 16 00:28:55.705280 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 212/412] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:55 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:55.726264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-eb5d4a14-3866-42bb-ac8e-693408f7f7f2 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.336160 Jun 16 00:28:55.726835 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 201/413] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:55 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:55.912646 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f11abe96-b455-45a5-a01a-bdb4260b0af2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:55.913180 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f11abe96-b455-45a5-a01a-bdb4260b0af2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:55.920821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f11abe96-b455-45a5-a01a-bdb4260b0af2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:55.924306 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f11abe96-b455-45a5-a01a-bdb4260b0af2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:55.925960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f11abe96-b455-45a5-a01a-bdb4260b0af2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:55.927841 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f11abe96-b455-45a5-a01a-bdb4260b0af2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:56.391302 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f11abe96-b455-45a5-a01a-bdb4260b0af2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:56.401815 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f11abe96-b455-45a5-a01a-bdb4260b0af2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.498282 Jun 16 00:28:56.414769 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 213/414] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:55 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:56.723252 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7f549510-9ada-4a05-a5e6-bb8d911eff3d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:56.727150 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7f549510-9ada-4a05-a5e6-bb8d911eff3d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:56.737819 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7f549510-9ada-4a05-a5e6-bb8d911eff3d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:56.739304 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7f549510-9ada-4a05-a5e6-bb8d911eff3d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:56.742831 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7f549510-9ada-4a05-a5e6-bb8d911eff3d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:56.743462 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7f549510-9ada-4a05-a5e6-bb8d911eff3d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:56.749870 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d13b3fe3-2945-47fe-90a3-d18df2c07b1c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:56.750979 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d13b3fe3-2945-47fe-90a3-d18df2c07b1c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:56.757856 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d13b3fe3-2945-47fe-90a3-d18df2c07b1c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:56.758303 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d13b3fe3-2945-47fe-90a3-d18df2c07b1c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:56.759293 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d13b3fe3-2945-47fe-90a3-d18df2c07b1c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:56.760493 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d13b3fe3-2945-47fe-90a3-d18df2c07b1c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:57.014589 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d13b3fe3-2945-47fe-90a3-d18df2c07b1c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:57.021739 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7f549510-9ada-4a05-a5e6-bb8d911eff3d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:57.031306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7f549510-9ada-4a05-a5e6-bb8d911eff3d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.312463 Jun 16 00:28:57.032515 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 202/415] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:56 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:57.040599 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d13b3fe3-2945-47fe-90a3-d18df2c07b1c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.301319 Jun 16 00:28:57.041840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 214/416] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:56 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:57.420554 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-84c520df-94d0-4c3c-8de6-89f705b30890 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:57.421158 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-84c520df-94d0-4c3c-8de6-89f705b30890 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:57.423020 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:57.423694 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=6 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:57.429956 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-84c520df-94d0-4c3c-8de6-89f705b30890 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:57.430417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-84c520df-94d0-4c3c-8de6-89f705b30890 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:57.431189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-84c520df-94d0-4c3c-8de6-89f705b30890 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:57.431639 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-84c520df-94d0-4c3c-8de6-89f705b30890 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:57.564934 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-84c520df-94d0-4c3c-8de6-89f705b30890 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:57.572434 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-84c520df-94d0-4c3c-8de6-89f705b30890 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.155677 Jun 16 00:28:57.572993 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 203/417] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:57 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:28:58.049670 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e7838872-3a2a-4849-a154-6785d39788cd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:58.050273 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e7838872-3a2a-4849-a154-6785d39788cd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:58.052327 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=6 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:58.058437 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-16911600-cbd4-448f-8405-851640d4352d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:58.059236 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-16911600-cbd4-448f-8405-851640d4352d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:58.060752 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e7838872-3a2a-4849-a154-6785d39788cd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:58.061194 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e7838872-3a2a-4849-a154-6785d39788cd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:58.062160 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e7838872-3a2a-4849-a154-6785d39788cd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:58.062773 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e7838872-3a2a-4849-a154-6785d39788cd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:58.067257 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-16911600-cbd4-448f-8405-851640d4352d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:58.067761 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-16911600-cbd4-448f-8405-851640d4352d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:58.068557 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-16911600-cbd4-448f-8405-851640d4352d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:58.068988 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-16911600-cbd4-448f-8405-851640d4352d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:58.283493 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-16911600-cbd4-448f-8405-851640d4352d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:58.291319 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-16911600-cbd4-448f-8405-851640d4352d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.236742 Jun 16 00:28:58.308344 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e7838872-3a2a-4849-a154-6785d39788cd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:58.313279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 204/418] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:58 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:58.316902 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e7838872-3a2a-4849-a154-6785d39788cd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.271053 Jun 16 00:28:58.317768 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 215/419] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:58 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:58.592693 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5ed5ce45-0c3d-481e-816f-1e02c2777b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:58.593225 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5ed5ce45-0c3d-481e-816f-1e02c2777b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:58.603090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5ed5ce45-0c3d-481e-816f-1e02c2777b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:58.603545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5ed5ce45-0c3d-481e-816f-1e02c2777b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:58.604368 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5ed5ce45-0c3d-481e-816f-1e02c2777b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:58.615013 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5ed5ce45-0c3d-481e-816f-1e02c2777b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:58.768515 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5ed5ce45-0c3d-481e-816f-1e02c2777b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:58.775904 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5ed5ce45-0c3d-481e-816f-1e02c2777b5d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.187248 Jun 16 00:28:58.776459 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 205/420] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:58 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:59.320928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cecccfdc-e5a5-4906-97c2-df05785da6a8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:59.321541 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-cecccfdc-e5a5-4906-97c2-df05785da6a8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:59.329337 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cecccfdc-e5a5-4906-97c2-df05785da6a8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:59.329793 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cecccfdc-e5a5-4906-97c2-df05785da6a8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:59.330566 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cecccfdc-e5a5-4906-97c2-df05785da6a8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:59.331267 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cecccfdc-e5a5-4906-97c2-df05785da6a8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:59.336594 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-061c8fc4-14cb-4774-bddb-bbfd8f02920f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:59.337863 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-061c8fc4-14cb-4774-bddb-bbfd8f02920f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:59.345478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-061c8fc4-14cb-4774-bddb-bbfd8f02920f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:59.346020 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-061c8fc4-14cb-4774-bddb-bbfd8f02920f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:59.346850 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-061c8fc4-14cb-4774-bddb-bbfd8f02920f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:59.347365 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-061c8fc4-14cb-4774-bddb-bbfd8f02920f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:59.535977 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-cecccfdc-e5a5-4906-97c2-df05785da6a8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:59.544869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-cecccfdc-e5a5-4906-97c2-df05785da6a8 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.227733 Jun 16 00:28:59.545696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 216/421] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:59 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:59.606683 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-061c8fc4-14cb-4774-bddb-bbfd8f02920f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:28:59.614962 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-061c8fc4-14cb-4774-bddb-bbfd8f02920f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.284377 Jun 16 00:28:59.615865 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 206/422] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:59 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:59.793912 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-66ebc0ea-21b2-4317-bb4e-ff26e4cd40a7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:59.794521 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-66ebc0ea-21b2-4317-bb4e-ff26e4cd40a7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:28:59.800767 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-66ebc0ea-21b2-4317-bb4e-ff26e4cd40a7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:59.801221 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-66ebc0ea-21b2-4317-bb4e-ff26e4cd40a7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:59.803340 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-66ebc0ea-21b2-4317-bb4e-ff26e4cd40a7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:28:59.804071 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-66ebc0ea-21b2-4317-bb4e-ff26e4cd40a7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:28:59.820534 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:00.051181 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-66ebc0ea-21b2-4317-bb4e-ff26e4cd40a7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:00.059291 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-66ebc0ea-21b2-4317-bb4e-ff26e4cd40a7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.268965 Jun 16 00:29:00.059912 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 217/423] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:28:59 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:00.562709 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-82bb42e9-d035-4c1b-80bb-c9ff2a15a6cb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:00.563331 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-82bb42e9-d035-4c1b-80bb-c9ff2a15a6cb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:00.569757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-82bb42e9-d035-4c1b-80bb-c9ff2a15a6cb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:00.570215 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-82bb42e9-d035-4c1b-80bb-c9ff2a15a6cb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:00.571006 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-82bb42e9-d035-4c1b-80bb-c9ff2a15a6cb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:00.571446 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-82bb42e9-d035-4c1b-80bb-c9ff2a15a6cb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:00.633834 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-29a3041d-f5cd-4bbb-9a0c-0f3860e50090 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:00.634536 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-29a3041d-f5cd-4bbb-9a0c-0f3860e50090 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:00.641466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-29a3041d-f5cd-4bbb-9a0c-0f3860e50090 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:00.641992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-29a3041d-f5cd-4bbb-9a0c-0f3860e50090 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:00.643296 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-29a3041d-f5cd-4bbb-9a0c-0f3860e50090 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:00.643861 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-29a3041d-f5cd-4bbb-9a0c-0f3860e50090 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:00.752790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-82bb42e9-d035-4c1b-80bb-c9ff2a15a6cb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:00.760446 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-82bb42e9-d035-4c1b-80bb-c9ff2a15a6cb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.202249 Jun 16 00:29:00.761010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 207/424] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:00 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:00.819740 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-29a3041d-f5cd-4bbb-9a0c-0f3860e50090 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:00.827820 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-29a3041d-f5cd-4bbb-9a0c-0f3860e50090 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.198129 Jun 16 00:29:00.828374 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 218/425] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:00 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:01.078546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-06abeed9-545c-4b2c-a7de-f5a4775d8421 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:01.079282 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-06abeed9-545c-4b2c-a7de-f5a4775d8421 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:01.092866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-06abeed9-545c-4b2c-a7de-f5a4775d8421 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:01.093466 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-06abeed9-545c-4b2c-a7de-f5a4775d8421 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:01.094474 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-06abeed9-545c-4b2c-a7de-f5a4775d8421 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:01.094972 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-06abeed9-545c-4b2c-a7de-f5a4775d8421 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:01.233531 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-06abeed9-545c-4b2c-a7de-f5a4775d8421 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:01.241143 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-06abeed9-545c-4b2c-a7de-f5a4775d8421 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.166955 Jun 16 00:29:01.242044 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 208/426] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:01 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:01.778066 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7b96fbb3-81c9-4006-ad04-01994895b269 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:01.778679 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7b96fbb3-81c9-4006-ad04-01994895b269 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:01.781545 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:01.787847 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7b96fbb3-81c9-4006-ad04-01994895b269 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:01.788407 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7b96fbb3-81c9-4006-ad04-01994895b269 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:01.789190 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7b96fbb3-81c9-4006-ad04-01994895b269 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:01.789860 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7b96fbb3-81c9-4006-ad04-01994895b269 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:01.846235 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-21fdec37-68b5-456e-82f9-c6c6c3c453a4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:01.846836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-21fdec37-68b5-456e-82f9-c6c6c3c453a4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:01.848739 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:01.853788 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-21fdec37-68b5-456e-82f9-c6c6c3c453a4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:01.854515 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-21fdec37-68b5-456e-82f9-c6c6c3c453a4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:01.855518 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-21fdec37-68b5-456e-82f9-c6c6c3c453a4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:01.856142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-21fdec37-68b5-456e-82f9-c6c6c3c453a4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:01.982914 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7b96fbb3-81c9-4006-ad04-01994895b269 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:01.990660 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7b96fbb3-81c9-4006-ad04-01994895b269 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.216251 Jun 16 00:29:01.991330 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 219/427] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:01 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:02.032170 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-21fdec37-68b5-456e-82f9-c6c6c3c453a4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:02.039583 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-21fdec37-68b5-456e-82f9-c6c6c3c453a4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.197149 Jun 16 00:29:02.040351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 209/428] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:01 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:02.258226 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-33d1aa76-cd3e-419f-bce6-54e1efc642b2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:02.258869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-33d1aa76-cd3e-419f-bce6-54e1efc642b2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:02.265807 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-33d1aa76-cd3e-419f-bce6-54e1efc642b2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:02.266260 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-33d1aa76-cd3e-419f-bce6-54e1efc642b2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:02.267035 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-33d1aa76-cd3e-419f-bce6-54e1efc642b2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:02.267473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-33d1aa76-cd3e-419f-bce6-54e1efc642b2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:02.402128 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-33d1aa76-cd3e-419f-bce6-54e1efc642b2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:02.411412 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-33d1aa76-cd3e-419f-bce6-54e1efc642b2 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.157007 Jun 16 00:29:02.412002 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 220/429] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:02 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:03.007796 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-60107ccc-d001-47f2-bd03-5941d44adafb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:03.008398 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-60107ccc-d001-47f2-bd03-5941d44adafb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:03.015125 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60107ccc-d001-47f2-bd03-5941d44adafb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:03.015574 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60107ccc-d001-47f2-bd03-5941d44adafb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.016356 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60107ccc-d001-47f2-bd03-5941d44adafb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:03.016789 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60107ccc-d001-47f2-bd03-5941d44adafb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.056346 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d1e90491-fc18-480e-b5fa-298cd9385965 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:03.057022 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d1e90491-fc18-480e-b5fa-298cd9385965 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:03.063684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d1e90491-fc18-480e-b5fa-298cd9385965 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:03.064211 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d1e90491-fc18-480e-b5fa-298cd9385965 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.064998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d1e90491-fc18-480e-b5fa-298cd9385965 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:03.065439 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d1e90491-fc18-480e-b5fa-298cd9385965 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.193953 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-60107ccc-d001-47f2-bd03-5941d44adafb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:03.202108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-60107ccc-d001-47f2-bd03-5941d44adafb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.198214 Jun 16 00:29:03.202769 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 210/430] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:03 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:03.227957 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d1e90491-fc18-480e-b5fa-298cd9385965 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:03.235338 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d1e90491-fc18-480e-b5fa-298cd9385965 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.182919 Jun 16 00:29:03.235929 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 221/431] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:03 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:03.428224 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-12a90f24-caf0-4c00-a281-62d7c8c28fc8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:03.428926 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-12a90f24-caf0-4c00-a281-62d7c8c28fc8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:03.435642 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-12a90f24-caf0-4c00-a281-62d7c8c28fc8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:03.436175 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-12a90f24-caf0-4c00-a281-62d7c8c28fc8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.436984 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-12a90f24-caf0-4c00-a281-62d7c8c28fc8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:03.437415 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-12a90f24-caf0-4c00-a281-62d7c8c28fc8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:03.569073 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-12a90f24-caf0-4c00-a281-62d7c8c28fc8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:03.576966 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-12a90f24-caf0-4c00-a281-62d7c8c28fc8 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.153029 Jun 16 00:29:03.577522 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 211/432] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:03 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:04.218111 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1366dc81-1464-4763-b8eb-d35b53637a93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:04.218753 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1366dc81-1464-4763-b8eb-d35b53637a93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:04.225205 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1366dc81-1464-4763-b8eb-d35b53637a93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:04.225654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1366dc81-1464-4763-b8eb-d35b53637a93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:04.226704 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1366dc81-1464-4763-b8eb-d35b53637a93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:04.227151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1366dc81-1464-4763-b8eb-d35b53637a93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:04.252210 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4b6e4538-bf85-4c6a-a4a0-cb58fb8d5647 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:04.252823 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4b6e4538-bf85-4c6a-a4a0-cb58fb8d5647 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:04.258874 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4b6e4538-bf85-4c6a-a4a0-cb58fb8d5647 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:04.259321 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4b6e4538-bf85-4c6a-a4a0-cb58fb8d5647 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:04.260125 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4b6e4538-bf85-4c6a-a4a0-cb58fb8d5647 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:04.260554 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4b6e4538-bf85-4c6a-a4a0-cb58fb8d5647 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:04.422622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1366dc81-1464-4763-b8eb-d35b53637a93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:04.425780 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4b6e4538-bf85-4c6a-a4a0-cb58fb8d5647 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:04.432213 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1366dc81-1464-4763-b8eb-d35b53637a93 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.217755 Jun 16 00:29:04.432715 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 222/433] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:04 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:04.433436 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4b6e4538-bf85-4c6a-a4a0-cb58fb8d5647 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.185044 Jun 16 00:29:04.434623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 212/434] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:04 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:04.593879 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9850ca57-ca1c-43fe-80c4-ae22897af1c7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:04.594483 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9850ca57-ca1c-43fe-80c4-ae22897af1c7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:04.600331 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9850ca57-ca1c-43fe-80c4-ae22897af1c7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:04.600771 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9850ca57-ca1c-43fe-80c4-ae22897af1c7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:04.601521 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9850ca57-ca1c-43fe-80c4-ae22897af1c7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:04.602068 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9850ca57-ca1c-43fe-80c4-ae22897af1c7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:04.734966 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9850ca57-ca1c-43fe-80c4-ae22897af1c7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:04.742369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9850ca57-ca1c-43fe-80c4-ae22897af1c7 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.152395 Jun 16 00:29:04.742922 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 223/435] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:04 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:05.449251 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-638671c7-4ffe-4c10-9973-53cc258e6463 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:05.450352 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-638671c7-4ffe-4c10-9973-53cc258e6463 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:05.450930 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-695efe57-ebeb-47f7-8e71-22742a4b8f1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:05.451780 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-695efe57-ebeb-47f7-8e71-22742a4b8f1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:05.456549 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-638671c7-4ffe-4c10-9973-53cc258e6463 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:05.457004 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-638671c7-4ffe-4c10-9973-53cc258e6463 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:05.457778 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-638671c7-4ffe-4c10-9973-53cc258e6463 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:05.458215 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-638671c7-4ffe-4c10-9973-53cc258e6463 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:05.458333 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-695efe57-ebeb-47f7-8e71-22742a4b8f1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:05.458675 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-695efe57-ebeb-47f7-8e71-22742a4b8f1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:05.459449 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-695efe57-ebeb-47f7-8e71-22742a4b8f1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:05.459915 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-695efe57-ebeb-47f7-8e71-22742a4b8f1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:05.654713 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-638671c7-4ffe-4c10-9973-53cc258e6463 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:05.658378 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-695efe57-ebeb-47f7-8e71-22742a4b8f1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:05.665818 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-638671c7-4ffe-4c10-9973-53cc258e6463 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.220414 Jun 16 00:29:05.666091 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-695efe57-ebeb-47f7-8e71-22742a4b8f1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.219362 Jun 16 00:29:05.666486 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 213/436] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:05 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:05.675194 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 224/437] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:05 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:05.760709 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ecb755a7-67ea-4629-a575-fa720378a2f0 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:05.761254 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ecb755a7-67ea-4629-a575-fa720378a2f0 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:05.769253 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ecb755a7-67ea-4629-a575-fa720378a2f0 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:05.769704 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ecb755a7-67ea-4629-a575-fa720378a2f0 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:05.771031 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ecb755a7-67ea-4629-a575-fa720378a2f0 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:05.771031 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ecb755a7-67ea-4629-a575-fa720378a2f0 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:05.902282 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ecb755a7-67ea-4629-a575-fa720378a2f0 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:05.909629 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ecb755a7-67ea-4629-a575-fa720378a2f0 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.153742 Jun 16 00:29:05.910189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 214/438] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:05 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:06.682756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0d8054e0-a763-4113-ad15-600968684bf3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:06.683359 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-91ef2756-56fb-4bdd-84b6-cc01dfe16c00 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:06.683860 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0d8054e0-a763-4113-ad15-600968684bf3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:06.683959 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-91ef2756-56fb-4bdd-84b6-cc01dfe16c00 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:06.689877 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d8054e0-a763-4113-ad15-600968684bf3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.690296 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-91ef2756-56fb-4bdd-84b6-cc01dfe16c00 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.690408 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d8054e0-a763-4113-ad15-600968684bf3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.690745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-91ef2756-56fb-4bdd-84b6-cc01dfe16c00 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.691091 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d8054e0-a763-4113-ad15-600968684bf3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.691510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-91ef2756-56fb-4bdd-84b6-cc01dfe16c00 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.691630 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d8054e0-a763-4113-ad15-600968684bf3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.691974 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-91ef2756-56fb-4bdd-84b6-cc01dfe16c00 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.881645 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0d8054e0-a763-4113-ad15-600968684bf3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:06.889107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-91ef2756-56fb-4bdd-84b6-cc01dfe16c00 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:06.890135 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0d8054e0-a763-4113-ad15-600968684bf3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.211356 Jun 16 00:29:06.890789 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 215/439] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:06 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:06.896748 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-91ef2756-56fb-4bdd-84b6-cc01dfe16c00 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.217987 Jun 16 00:29:06.897295 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 225/440] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:06 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:06.925969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f373439d-9a96-46d0-a81a-39da44bd8b6d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:06.926575 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f373439d-9a96-46d0-a81a-39da44bd8b6d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:06.932406 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f373439d-9a96-46d0-a81a-39da44bd8b6d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.932907 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f373439d-9a96-46d0-a81a-39da44bd8b6d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.933614 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f373439d-9a96-46d0-a81a-39da44bd8b6d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:06.934608 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f373439d-9a96-46d0-a81a-39da44bd8b6d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:06.951910 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=100 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:07.060423 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f373439d-9a96-46d0-a81a-39da44bd8b6d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:07.067766 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f373439d-9a96-46d0-a81a-39da44bd8b6d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.145462 Jun 16 00:29:07.068327 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 216/441] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:06 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:07.906036 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ef3507bd-6b8a-49a0-a0c0-57dbc8ca6475 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:07.906643 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ef3507bd-6b8a-49a0-a0c0-57dbc8ca6475 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:07.913297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a9a11221-70ed-4170-acaf-010a585d90f6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:07.914019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a9a11221-70ed-4170-acaf-010a585d90f6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:07.915356 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ef3507bd-6b8a-49a0-a0c0-57dbc8ca6475 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:07.915864 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ef3507bd-6b8a-49a0-a0c0-57dbc8ca6475 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:07.916642 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ef3507bd-6b8a-49a0-a0c0-57dbc8ca6475 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:07.917077 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ef3507bd-6b8a-49a0-a0c0-57dbc8ca6475 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:07.924663 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a9a11221-70ed-4170-acaf-010a585d90f6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:07.925101 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a9a11221-70ed-4170-acaf-010a585d90f6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:07.926039 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a9a11221-70ed-4170-acaf-010a585d90f6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:07.926469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a9a11221-70ed-4170-acaf-010a585d90f6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:08.118501 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ef3507bd-6b8a-49a0-a0c0-57dbc8ca6475 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:08.121740 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a9a11221-70ed-4170-acaf-010a585d90f6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:08.129341 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a9a11221-70ed-4170-acaf-010a585d90f6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.220051 Jun 16 00:29:08.130121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ef3507bd-6b8a-49a0-a0c0-57dbc8ca6475 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.226971 Jun 16 00:29:08.130246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 217/442] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:07 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:08.135004 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-982730db-9cc9-4f30-8fed-36c2bb57e792 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:08.135859 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-982730db-9cc9-4f30-8fed-36c2bb57e792 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:08.142248 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 226/443] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:07 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:08.143706 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-982730db-9cc9-4f30-8fed-36c2bb57e792 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:08.144470 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-982730db-9cc9-4f30-8fed-36c2bb57e792 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:08.145298 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-982730db-9cc9-4f30-8fed-36c2bb57e792 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:08.145732 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-982730db-9cc9-4f30-8fed-36c2bb57e792 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:08.286128 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-982730db-9cc9-4f30-8fed-36c2bb57e792 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:08.294209 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-982730db-9cc9-4f30-8fed-36c2bb57e792 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.162801 Jun 16 00:29:08.294767 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 218/444] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:08 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:09.146267 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-592ea029-5de0-4c36-a2f5-5610a1bb804a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:09.146788 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-592ea029-5de0-4c36-a2f5-5610a1bb804a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:09.148553 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5dcc9107-39f0-410b-a16e-f419e73c273d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:09.149156 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5dcc9107-39f0-410b-a16e-f419e73c273d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:09.153971 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-592ea029-5de0-4c36-a2f5-5610a1bb804a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.154414 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-592ea029-5de0-4c36-a2f5-5610a1bb804a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.155196 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-592ea029-5de0-4c36-a2f5-5610a1bb804a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.155662 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-592ea029-5de0-4c36-a2f5-5610a1bb804a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.155936 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5dcc9107-39f0-410b-a16e-f419e73c273d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.156423 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5dcc9107-39f0-410b-a16e-f419e73c273d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.157340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5dcc9107-39f0-410b-a16e-f419e73c273d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.157781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5dcc9107-39f0-410b-a16e-f419e73c273d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.351476 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-592ea029-5de0-4c36-a2f5-5610a1bb804a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:09.355152 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5dcc9107-39f0-410b-a16e-f419e73c273d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:09.359107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-592ea029-5de0-4c36-a2f5-5610a1bb804a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.216757 Jun 16 00:29:09.359684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 227/445] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:09 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:09.363088 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5dcc9107-39f0-410b-a16e-f419e73c273d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.218238 Jun 16 00:29:09.363803 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 219/446] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:09 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:09.364076 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c0ddb957-029d-4783-a071-e78414096911 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:09.364675 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c0ddb957-029d-4783-a071-e78414096911 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:09.370329 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c0ddb957-029d-4783-a071-e78414096911 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.370776 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c0ddb957-029d-4783-a071-e78414096911 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.372065 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c0ddb957-029d-4783-a071-e78414096911 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:09.372498 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c0ddb957-029d-4783-a071-e78414096911 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:09.499044 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c0ddb957-029d-4783-a071-e78414096911 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:09.506419 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c0ddb957-029d-4783-a071-e78414096911 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.145773 Jun 16 00:29:09.506972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 228/447] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:09 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:10.375898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2e57f877-e17f-4b7d-81ce-1722b6c946d9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:10.376584 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2e57f877-e17f-4b7d-81ce-1722b6c946d9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:10.380199 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-69ca3e92-9068-448a-8e64-aa60018a8aae tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:10.380805 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-69ca3e92-9068-448a-8e64-aa60018a8aae tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:10.382567 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2e57f877-e17f-4b7d-81ce-1722b6c946d9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:10.383001 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2e57f877-e17f-4b7d-81ce-1722b6c946d9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:10.383798 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2e57f877-e17f-4b7d-81ce-1722b6c946d9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:10.384230 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2e57f877-e17f-4b7d-81ce-1722b6c946d9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:10.388643 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-69ca3e92-9068-448a-8e64-aa60018a8aae tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:10.389089 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-69ca3e92-9068-448a-8e64-aa60018a8aae tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:10.389853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-69ca3e92-9068-448a-8e64-aa60018a8aae tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:10.390284 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-69ca3e92-9068-448a-8e64-aa60018a8aae tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:10.576228 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2e57f877-e17f-4b7d-81ce-1722b6c946d9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:10.579505 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-69ca3e92-9068-448a-8e64-aa60018a8aae tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:10.584086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2e57f877-e17f-4b7d-81ce-1722b6c946d9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.212153 Jun 16 00:29:10.584749 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 220/448] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:10 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:10.587712 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-69ca3e92-9068-448a-8e64-aa60018a8aae tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.211452 Jun 16 00:29:10.588405 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 229/449] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:10 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:10.589609 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2bf95835-6e74-421e-83b1-15bfb234de66 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:10.590213 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2bf95835-6e74-421e-83b1-15bfb234de66 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:10.597093 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2bf95835-6e74-421e-83b1-15bfb234de66 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:10.597558 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2bf95835-6e74-421e-83b1-15bfb234de66 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:10.598301 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2bf95835-6e74-421e-83b1-15bfb234de66 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:10.598739 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2bf95835-6e74-421e-83b1-15bfb234de66 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:10.724856 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2bf95835-6e74-421e-83b1-15bfb234de66 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:10.732221 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2bf95835-6e74-421e-83b1-15bfb234de66 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.146478 Jun 16 00:29:10.732784 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 221/450] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:10 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:11.601248 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6187d959-6429-43b3-aa16-5ae202b83070 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:11.601846 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-6187d959-6429-43b3-aa16-5ae202b83070 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:11.604928 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-43c80f35-4e85-4d64-be86-e454a43a4fb3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:11.605540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-43c80f35-4e85-4d64-be86-e454a43a4fb3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:11.608560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6187d959-6429-43b3-aa16-5ae202b83070 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.608782 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6187d959-6429-43b3-aa16-5ae202b83070 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.609543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6187d959-6429-43b3-aa16-5ae202b83070 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.609968 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6187d959-6429-43b3-aa16-5ae202b83070 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.611838 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-43c80f35-4e85-4d64-be86-e454a43a4fb3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.612298 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-43c80f35-4e85-4d64-be86-e454a43a4fb3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.613084 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-43c80f35-4e85-4d64-be86-e454a43a4fb3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.613551 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-43c80f35-4e85-4d64-be86-e454a43a4fb3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.802215 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-6187d959-6429-43b3-aa16-5ae202b83070 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:11.809054 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-43c80f35-4e85-4d64-be86-e454a43a4fb3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:11.810293 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-6187d959-6429-43b3-aa16-5ae202b83070 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.212229 Jun 16 00:29:11.810865 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 230/451] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:11 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:11.815267 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7a06727f-de1f-4e82-a078-4894b83e63a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:11.815900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7a06727f-de1f-4e82-a078-4894b83e63a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:11.817649 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-43c80f35-4e85-4d64-be86-e454a43a4fb3 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.216625 Jun 16 00:29:11.818425 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 222/452] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:11 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:11.821924 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7a06727f-de1f-4e82-a078-4894b83e63a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.822376 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7a06727f-de1f-4e82-a078-4894b83e63a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.823147 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7a06727f-de1f-4e82-a078-4894b83e63a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:11.823588 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7a06727f-de1f-4e82-a078-4894b83e63a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:11.953324 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7a06727f-de1f-4e82-a078-4894b83e63a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:11.960750 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7a06727f-de1f-4e82-a078-4894b83e63a1 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.148952 Jun 16 00:29:11.961324 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 231/453] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:11 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:12.827807 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-68669024-ffcf-4dd2-97aa-9218eadfc1a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:12.828441 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-68669024-ffcf-4dd2-97aa-9218eadfc1a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:12.834015 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ba2ab746-e93a-4cf2-b3a7-f57342d0ac00 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:12.834480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-68669024-ffcf-4dd2-97aa-9218eadfc1a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:12.834699 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ba2ab746-e93a-4cf2-b3a7-f57342d0ac00 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:12.834923 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-68669024-ffcf-4dd2-97aa-9218eadfc1a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:12.835816 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-68669024-ffcf-4dd2-97aa-9218eadfc1a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:12.836252 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-68669024-ffcf-4dd2-97aa-9218eadfc1a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:12.840619 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ba2ab746-e93a-4cf2-b3a7-f57342d0ac00 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:12.841657 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ba2ab746-e93a-4cf2-b3a7-f57342d0ac00 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:12.842413 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ba2ab746-e93a-4cf2-b3a7-f57342d0ac00 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:12.842843 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ba2ab746-e93a-4cf2-b3a7-f57342d0ac00 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:13.027558 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-68669024-ffcf-4dd2-97aa-9218eadfc1a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:13.031665 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ba2ab746-e93a-4cf2-b3a7-f57342d0ac00 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:13.035148 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-68669024-ffcf-4dd2-97aa-9218eadfc1a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.211693 Jun 16 00:29:13.035792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 223/454] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:12 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:13.039176 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ba2ab746-e93a-4cf2-b3a7-f57342d0ac00 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.209002 Jun 16 00:29:13.039907 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 232/455] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:12 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:13.040238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-89f8cf9b-05cf-4f87-b1d5-d12c00366d04 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:13.040908 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-89f8cf9b-05cf-4f87-b1d5-d12c00366d04 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:13.046847 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89f8cf9b-05cf-4f87-b1d5-d12c00366d04 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:13.047351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89f8cf9b-05cf-4f87-b1d5-d12c00366d04 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:13.048139 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89f8cf9b-05cf-4f87-b1d5-d12c00366d04 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:13.048569 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89f8cf9b-05cf-4f87-b1d5-d12c00366d04 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:13.173933 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-89f8cf9b-05cf-4f87-b1d5-d12c00366d04 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:13.181319 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-89f8cf9b-05cf-4f87-b1d5-d12c00366d04 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.144579 Jun 16 00:29:13.181883 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 224/456] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:13 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:14.052121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-34bc673f-46df-4487-ae09-ff5699fb9e82 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:14.052638 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-34bc673f-46df-4487-ae09-ff5699fb9e82 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:14.055526 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8c9631db-1c9d-487d-8971-62c469b946b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:14.056189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8c9631db-1c9d-487d-8971-62c469b946b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:14.059215 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-34bc673f-46df-4487-ae09-ff5699fb9e82 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:14.059684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-34bc673f-46df-4487-ae09-ff5699fb9e82 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:14.060449 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-34bc673f-46df-4487-ae09-ff5699fb9e82 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:14.060881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-34bc673f-46df-4487-ae09-ff5699fb9e82 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:14.062163 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8c9631db-1c9d-487d-8971-62c469b946b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:14.062618 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8c9631db-1c9d-487d-8971-62c469b946b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:14.063386 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8c9631db-1c9d-487d-8971-62c469b946b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:14.063857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8c9631db-1c9d-487d-8971-62c469b946b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:14.252429 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-34bc673f-46df-4487-ae09-ff5699fb9e82 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:14.255802 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8c9631db-1c9d-487d-8971-62c469b946b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:14.259840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-34bc673f-46df-4487-ae09-ff5699fb9e82 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.211805 Jun 16 00:29:14.260406 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 233/457] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:14 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:14.263770 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8c9631db-1c9d-487d-8971-62c469b946b9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.212004 Jun 16 00:29:14.264603 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 225/458] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:14 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:14.265288 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b2f882c4-79db-49b0-bf33-256117b7c414 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:14.265883 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b2f882c4-79db-49b0-bf33-256117b7c414 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:14.272419 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b2f882c4-79db-49b0-bf33-256117b7c414 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:14.272871 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b2f882c4-79db-49b0-bf33-256117b7c414 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:14.273632 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b2f882c4-79db-49b0-bf33-256117b7c414 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:14.274066 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b2f882c4-79db-49b0-bf33-256117b7c414 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:14.277950 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=100 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:14.399822 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b2f882c4-79db-49b0-bf33-256117b7c414 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:14.407184 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b2f882c4-79db-49b0-bf33-256117b7c414 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.145842 Jun 16 00:29:14.407769 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 234/459] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:14 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:15.280556 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d6f748fa-9886-4802-9b3f-b4b78003596f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:15.281217 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d6f748fa-9886-4802-9b3f-b4b78003596f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:15.281326 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-df78340b-38dc-43ac-8711-639787ff1728 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:15.281751 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-df78340b-38dc-43ac-8711-639787ff1728 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:15.287640 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-df78340b-38dc-43ac-8711-639787ff1728 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:15.287800 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d6f748fa-9886-4802-9b3f-b4b78003596f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:15.288087 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-df78340b-38dc-43ac-8711-639787ff1728 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:15.288189 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d6f748fa-9886-4802-9b3f-b4b78003596f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:15.288868 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-df78340b-38dc-43ac-8711-639787ff1728 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:15.288973 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d6f748fa-9886-4802-9b3f-b4b78003596f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:15.289300 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-df78340b-38dc-43ac-8711-639787ff1728 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:15.289422 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d6f748fa-9886-4802-9b3f-b4b78003596f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:15.479236 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-df78340b-38dc-43ac-8711-639787ff1728 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:15.483686 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d6f748fa-9886-4802-9b3f-b4b78003596f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:15.487210 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-df78340b-38dc-43ac-8711-639787ff1728 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.213071 Jun 16 00:29:15.487801 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 226/460] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:15 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:15.490961 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d6f748fa-9886-4802-9b3f-b4b78003596f tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.214646 Jun 16 00:29:15.491684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 235/461] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:15 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:15.492477 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e241539b-10ee-4b10-a69f-14dd4f0b1471 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:15.493082 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e241539b-10ee-4b10-a69f-14dd4f0b1471 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:15.498984 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e241539b-10ee-4b10-a69f-14dd4f0b1471 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:15.499433 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e241539b-10ee-4b10-a69f-14dd4f0b1471 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:15.500228 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e241539b-10ee-4b10-a69f-14dd4f0b1471 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:15.500663 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e241539b-10ee-4b10-a69f-14dd4f0b1471 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:15.629355 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e241539b-10ee-4b10-a69f-14dd4f0b1471 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:15.636711 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e241539b-10ee-4b10-a69f-14dd4f0b1471 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.147951 Jun 16 00:29:15.637258 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 227/462] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:15 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:16.503389 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-24b80f05-8348-4aa3-a76e-67c9bdbec4ee tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:16.504040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-24b80f05-8348-4aa3-a76e-67c9bdbec4ee tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:16.507326 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bf017626-d095-4fcf-b1c6-3e934b4abce4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:16.507967 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bf017626-d095-4fcf-b1c6-3e934b4abce4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:16.510842 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-24b80f05-8348-4aa3-a76e-67c9bdbec4ee tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:16.511281 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-24b80f05-8348-4aa3-a76e-67c9bdbec4ee tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:16.512075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-24b80f05-8348-4aa3-a76e-67c9bdbec4ee tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:16.512504 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-24b80f05-8348-4aa3-a76e-67c9bdbec4ee tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:16.514604 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bf017626-d095-4fcf-b1c6-3e934b4abce4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:16.515054 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bf017626-d095-4fcf-b1c6-3e934b4abce4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:16.515852 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bf017626-d095-4fcf-b1c6-3e934b4abce4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:16.516287 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bf017626-d095-4fcf-b1c6-3e934b4abce4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:16.708657 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-24b80f05-8348-4aa3-a76e-67c9bdbec4ee tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:16.711747 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bf017626-d095-4fcf-b1c6-3e934b4abce4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:16.716163 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-24b80f05-8348-4aa3-a76e-67c9bdbec4ee tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.217084 Jun 16 00:29:16.716721 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 236/463] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:16 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:16.719481 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bf017626-d095-4fcf-b1c6-3e934b4abce4 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.215877 Jun 16 00:29:16.720216 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 228/464] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:16 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:16.721091 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f4ceca12-2966-445d-8fa8-50d26bc28be9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:16.721682 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f4ceca12-2966-445d-8fa8-50d26bc28be9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:16.727520 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4ceca12-2966-445d-8fa8-50d26bc28be9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:16.728042 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4ceca12-2966-445d-8fa8-50d26bc28be9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:16.728806 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4ceca12-2966-445d-8fa8-50d26bc28be9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:16.729235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4ceca12-2966-445d-8fa8-50d26bc28be9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:16.855825 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f4ceca12-2966-445d-8fa8-50d26bc28be9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:16.863209 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f4ceca12-2966-445d-8fa8-50d26bc28be9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.145535 Jun 16 00:29:16.863782 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 237/465] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:16 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:17.733682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-fb899644-512c-4be2-ac5e-c1d1751926ea tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:17.734356 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-fb899644-512c-4be2-ac5e-c1d1751926ea tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:17.737431 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6a536fdb-ab46-4a0a-8c4a-856264416b89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:17.738111 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-6a536fdb-ab46-4a0a-8c4a-856264416b89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:17.740864 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fb899644-512c-4be2-ac5e-c1d1751926ea tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:17.741327 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fb899644-512c-4be2-ac5e-c1d1751926ea tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:17.742117 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fb899644-512c-4be2-ac5e-c1d1751926ea tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:17.742552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fb899644-512c-4be2-ac5e-c1d1751926ea tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:17.744517 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6a536fdb-ab46-4a0a-8c4a-856264416b89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:17.744972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6a536fdb-ab46-4a0a-8c4a-856264416b89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:17.745739 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6a536fdb-ab46-4a0a-8c4a-856264416b89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:17.746178 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6a536fdb-ab46-4a0a-8c4a-856264416b89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:17.940426 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fb899644-512c-4be2-ac5e-c1d1751926ea tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:17.943604 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-6a536fdb-ab46-4a0a-8c4a-856264416b89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:17.947841 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-fb899644-512c-4be2-ac5e-c1d1751926ea tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.218766 Jun 16 00:29:17.948408 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 229/466] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:17 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:17.951586 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-6a536fdb-ab46-4a0a-8c4a-856264416b89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.218528 Jun 16 00:29:17.952171 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 238/467] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:17 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:17.953598 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5e783fa1-92d2-4912-ac72-ee4d2a8cae0d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:17.954263 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5e783fa1-92d2-4912-ac72-ee4d2a8cae0d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:17.960195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5e783fa1-92d2-4912-ac72-ee4d2a8cae0d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:17.960855 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5e783fa1-92d2-4912-ac72-ee4d2a8cae0d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:17.961618 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5e783fa1-92d2-4912-ac72-ee4d2a8cae0d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:17.962055 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5e783fa1-92d2-4912-ac72-ee4d2a8cae0d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:18.087154 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5e783fa1-92d2-4912-ac72-ee4d2a8cae0d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:18.095087 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5e783fa1-92d2-4912-ac72-ee4d2a8cae0d tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.145731 Jun 16 00:29:18.095652 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 230/468] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:17 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:18.965137 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-94347c41-db41-4ef1-af58-469ba15bf642 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:18.965756 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-94347c41-db41-4ef1-af58-469ba15bf642 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:18.973419 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-94347c41-db41-4ef1-af58-469ba15bf642 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:18.974006 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-94347c41-db41-4ef1-af58-469ba15bf642 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:18.974311 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-dcc087fc-e5a3-4303-970b-2fc91bc60551 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:18.974923 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-94347c41-db41-4ef1-af58-469ba15bf642 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:18.975120 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-dcc087fc-e5a3-4303-970b-2fc91bc60551 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:18.975438 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-94347c41-db41-4ef1-af58-469ba15bf642 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:18.981105 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dcc087fc-e5a3-4303-970b-2fc91bc60551 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:18.981550 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dcc087fc-e5a3-4303-970b-2fc91bc60551 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:18.983258 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dcc087fc-e5a3-4303-970b-2fc91bc60551 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:18.983914 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dcc087fc-e5a3-4303-970b-2fc91bc60551 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:19.167806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-dcc087fc-e5a3-4303-970b-2fc91bc60551 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:19.178652 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-dcc087fc-e5a3-4303-970b-2fc91bc60551 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1371 microversion: 2.1 time: 0.205493 Jun 16 00:29:19.179587 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 231/469] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:18 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:19.192221 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c8f208b8-7263-4c16-a1bb-1121f17e6c75 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:19.193010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c8f208b8-7263-4c16-a1bb-1121f17e6c75 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:19.201993 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c8f208b8-7263-4c16-a1bb-1121f17e6c75 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:19.202441 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c8f208b8-7263-4c16-a1bb-1121f17e6c75 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:19.203927 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c8f208b8-7263-4c16-a1bb-1121f17e6c75 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:19.204360 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c8f208b8-7263-4c16-a1bb-1121f17e6c75 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:19.265343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-94347c41-db41-4ef1-af58-469ba15bf642 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:19.276252 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-94347c41-db41-4ef1-af58-469ba15bf642 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.314887 Jun 16 00:29:19.286987 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 239/470] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:18 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:19.360356 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c8f208b8-7263-4c16-a1bb-1121f17e6c75 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:19.367811 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c8f208b8-7263-4c16-a1bb-1121f17e6c75 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.186820 Jun 16 00:29:19.368374 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 232/471] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:19 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:19.696192 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-049f40b0-b633-4fa2-9638-d870bc05a92a req-9f74cce6-b742-4a95-b6da-9125e659678c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f55ea4-7849-4165-9708-f6e0925a32e8", "tag": "ee01316d-3ff6-4e30-aa8e-9bdb422b6864"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:19.709444 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-049f40b0-b633-4fa2-9638-d870bc05a92a req-9f74cce6-b742-4a95-b6da-9125e659678c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:19.710311 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-049f40b0-b633-4fa2-9638-d870bc05a92a req-9f74cce6-b742-4a95-b6da-9125e659678c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:19.732574 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-049f40b0-b633-4fa2-9638-d870bc05a92a req-9f74cce6-b742-4a95-b6da-9125e659678c service nova] Creating event network-changed:ee01316d-3ff6-4e30-aa8e-9bdb422b6864 for instance c3f55ea4-7849-4165-9708-f6e0925a32e8 on hv-cinder-84327 Jun 16 00:29:19.737636 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-049f40b0-b633-4fa2-9638-d870bc05a92a req-9f74cce6-b742-4a95-b6da-9125e659678c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045199 Jun 16 00:29:19.738260 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 240/472] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:20.195625 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-962d5f99-b21f-4b4a-977b-b2161d4e82a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:20.196248 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-962d5f99-b21f-4b4a-977b-b2161d4e82a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:20.202937 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-962d5f99-b21f-4b4a-977b-b2161d4e82a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:20.203387 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-962d5f99-b21f-4b4a-977b-b2161d4e82a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.204226 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-962d5f99-b21f-4b4a-977b-b2161d4e82a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:20.204622 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-962d5f99-b21f-4b4a-977b-b2161d4e82a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.208617 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=100 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:20.294484 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-00374262-62fb-4d4f-8bba-5c4449c1cbf5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:20.295183 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-00374262-62fb-4d4f-8bba-5c4449c1cbf5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:20.301827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-00374262-62fb-4d4f-8bba-5c4449c1cbf5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:20.302278 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-00374262-62fb-4d4f-8bba-5c4449c1cbf5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.303042 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-00374262-62fb-4d4f-8bba-5c4449c1cbf5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:20.303477 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-00374262-62fb-4d4f-8bba-5c4449c1cbf5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.333981 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-962d5f99-b21f-4b4a-977b-b2161d4e82a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:20.342034 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-962d5f99-b21f-4b4a-977b-b2161d4e82a6 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1566 microversion: 2.1 time: 0.149685 Jun 16 00:29:20.342598 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 233/473] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:20 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:20.358817 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-30f409d5-a24a-4c5d-b810-0a0da0456e89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:20.359320 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-30f409d5-a24a-4c5d-b810-0a0da0456e89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:20.365553 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-30f409d5-a24a-4c5d-b810-0a0da0456e89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:20.366013 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-30f409d5-a24a-4c5d-b810-0a0da0456e89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.366794 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-30f409d5-a24a-4c5d-b810-0a0da0456e89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:20.367231 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-30f409d5-a24a-4c5d-b810-0a0da0456e89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.467323 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-30f409d5-a24a-4c5d-b810-0a0da0456e89 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112136 Jun 16 00:29:20.467950 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 234/474] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 16 00:29:20 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:29:20.472784 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2072c984-53d1-4ca7-ac2f-9d1613005646 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:20.473380 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2072c984-53d1-4ca7-ac2f-9d1613005646 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:20.481760 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2072c984-53d1-4ca7-ac2f-9d1613005646 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:20.482849 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2072c984-53d1-4ca7-ac2f-9d1613005646 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.483892 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2072c984-53d1-4ca7-ac2f-9d1613005646 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:20.484521 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2072c984-53d1-4ca7-ac2f-9d1613005646 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:20.484986 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-00374262-62fb-4d4f-8bba-5c4449c1cbf5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:20.493788 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-00374262-62fb-4d4f-8bba-5c4449c1cbf5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.203351 Jun 16 00:29:20.494731 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 241/475] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:20 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:20.628133 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2072c984-53d1-4ca7-ac2f-9d1613005646 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:20.636759 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2072c984-53d1-4ca7-ac2f-9d1613005646 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.167342 Jun 16 00:29:20.637565 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 235/476] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:20 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:21.511487 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-98a63795-bfd1-4494-ac8c-95aea42bb89a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:21.512164 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-98a63795-bfd1-4494-ac8c-95aea42bb89a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:21.519836 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-98a63795-bfd1-4494-ac8c-95aea42bb89a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:21.520727 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-98a63795-bfd1-4494-ac8c-95aea42bb89a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:21.522173 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-98a63795-bfd1-4494-ac8c-95aea42bb89a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:21.522772 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-98a63795-bfd1-4494-ac8c-95aea42bb89a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:21.654868 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-dc0b1e7a-dd4c-4647-8898-8bbe92e505bc tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:21.655487 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-dc0b1e7a-dd4c-4647-8898-8bbe92e505bc tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:21.661789 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dc0b1e7a-dd4c-4647-8898-8bbe92e505bc tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:21.662468 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dc0b1e7a-dd4c-4647-8898-8bbe92e505bc tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:21.663404 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dc0b1e7a-dd4c-4647-8898-8bbe92e505bc tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:21.664012 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dc0b1e7a-dd4c-4647-8898-8bbe92e505bc tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:21.707653 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-98a63795-bfd1-4494-ac8c-95aea42bb89a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:21.720564 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-98a63795-bfd1-4494-ac8c-95aea42bb89a tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.212852 Jun 16 00:29:21.724405 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 242/477] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:21 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:21.828773 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-dc0b1e7a-dd4c-4647-8898-8bbe92e505bc tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:21.836437 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-dc0b1e7a-dd4c-4647-8898-8bbe92e505bc tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1505 microversion: 2.1 time: 0.185930 Jun 16 00:29:21.836999 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 236/478] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:21 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:22.016811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-103caa11-3c9b-4c60-8234-fb5c4b2bf055 req-c8ad7271-27ae-47a7-a62c-1515bc7a520c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe074b6c-d316-4e61-8478-6c96ecb2dcf9", "name": "network-vif-deleted", "tag": "2955b09d-4afa-4de5-ba8a-a412a3b2fd88"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:22.027323 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-103caa11-3c9b-4c60-8234-fb5c4b2bf055 req-c8ad7271-27ae-47a7-a62c-1515bc7a520c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.027845 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-103caa11-3c9b-4c60-8234-fb5c4b2bf055 req-c8ad7271-27ae-47a7-a62c-1515bc7a520c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.040097 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-103caa11-3c9b-4c60-8234-fb5c4b2bf055 req-c8ad7271-27ae-47a7-a62c-1515bc7a520c service nova] Creating event network-vif-deleted:2955b09d-4afa-4de5-ba8a-a412a3b2fd88 for instance fe074b6c-d316-4e61-8478-6c96ecb2dcf9 on hv-cinder-84327 Jun 16 00:29:22.045419 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-103caa11-3c9b-4c60-8234-fb5c4b2bf055 req-c8ad7271-27ae-47a7-a62c-1515bc7a520c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033354 Jun 16 00:29:22.046280 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 243/479] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:22.740900 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-828f5549-5e18-4bf5-9cfb-fe3f5d82ff05 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:22.741509 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-828f5549-5e18-4bf5-9cfb-fe3f5d82ff05 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:22.747439 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-828f5549-5e18-4bf5-9cfb-fe3f5d82ff05 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.747921 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-828f5549-5e18-4bf5-9cfb-fe3f5d82ff05 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.748687 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-828f5549-5e18-4bf5-9cfb-fe3f5d82ff05 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.749122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-828f5549-5e18-4bf5-9cfb-fe3f5d82ff05 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.854507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3eceb1fa-e6aa-4aa7-b626-127d496fef5a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:22.855548 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-3eceb1fa-e6aa-4aa7-b626-127d496fef5a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:22.863504 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3eceb1fa-e6aa-4aa7-b626-127d496fef5a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.864028 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3eceb1fa-e6aa-4aa7-b626-127d496fef5a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.865218 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3eceb1fa-e6aa-4aa7-b626-127d496fef5a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:22.865665 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3eceb1fa-e6aa-4aa7-b626-127d496fef5a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:22.884885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-828f5549-5e18-4bf5-9cfb-fe3f5d82ff05 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:22.896976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-828f5549-5e18-4bf5-9cfb-fe3f5d82ff05 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.159510 Jun 16 00:29:22.898707 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 237/480] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:22 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:22.935358 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3eceb1fa-e6aa-4aa7-b626-127d496fef5a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:22.943520 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3eceb1fa-e6aa-4aa7-b626-127d496fef5a tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1463 microversion: 2.1 time: 0.093484 Jun 16 00:29:22.944116 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 244/481] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:22 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1463 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:23.915077 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4410df58-1a69-4674-a72b-eeb2c5df1515 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:23.916369 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4410df58-1a69-4674-a72b-eeb2c5df1515 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:23.922872 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4410df58-1a69-4674-a72b-eeb2c5df1515 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:23.923262 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4410df58-1a69-4674-a72b-eeb2c5df1515 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:23.924054 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4410df58-1a69-4674-a72b-eeb2c5df1515 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:23.924490 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4410df58-1a69-4674-a72b-eeb2c5df1515 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:23.961475 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0791dd7e-ecf1-47c8-8b6d-4ec79cf6126c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:23.962630 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0791dd7e-ecf1-47c8-8b6d-4ec79cf6126c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:23.969214 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0791dd7e-ecf1-47c8-8b6d-4ec79cf6126c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:23.969952 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0791dd7e-ecf1-47c8-8b6d-4ec79cf6126c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:23.970815 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0791dd7e-ecf1-47c8-8b6d-4ec79cf6126c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:23.971322 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0791dd7e-ecf1-47c8-8b6d-4ec79cf6126c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:24.059105 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0791dd7e-ecf1-47c8-8b6d-4ec79cf6126c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:24.069552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0791dd7e-ecf1-47c8-8b6d-4ec79cf6126c tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1463 microversion: 2.1 time: 0.112475 Jun 16 00:29:24.080312 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 245/482] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:23 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1463 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:24.089376 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-b94c0e62-b021-4e68-93c5-b3022395cac8 req-180d2c4d-9957-410c-a455-e27a1d5d11af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a2ac88-a177-4fc8-867b-eef87107e914", "tag": "0e361567-aa2b-46e9-a10e-0d979e26890a"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:24.099579 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-b94c0e62-b021-4e68-93c5-b3022395cac8 req-180d2c4d-9957-410c-a455-e27a1d5d11af service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:24.104181 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-b94c0e62-b021-4e68-93c5-b3022395cac8 req-180d2c4d-9957-410c-a455-e27a1d5d11af service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:24.111478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4410df58-1a69-4674-a72b-eeb2c5df1515 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:24.117518 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-b94c0e62-b021-4e68-93c5-b3022395cac8 req-180d2c4d-9957-410c-a455-e27a1d5d11af service nova] Creating event network-changed:0e361567-aa2b-46e9-a10e-0d979e26890a for instance f4a2ac88-a177-4fc8-867b-eef87107e914 on hv-cinder-84327 Jun 16 00:29:24.120924 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4410df58-1a69-4674-a72b-eeb2c5df1515 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.209492 Jun 16 00:29:24.121628 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 238/483] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:23 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:24.124009 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-b94c0e62-b021-4e68-93c5-b3022395cac8 req-180d2c4d-9957-410c-a455-e27a1d5d11af service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040030 Jun 16 00:29:24.124592 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 246/484] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:29:25.086397 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-cf833556-8888-4220-aa3f-c7aeb0bb29da tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:25.086914 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-cf833556-8888-4220-aa3f-c7aeb0bb29da tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:25.093696 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cf833556-8888-4220-aa3f-c7aeb0bb29da tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:25.094142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cf833556-8888-4220-aa3f-c7aeb0bb29da tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:25.094907 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cf833556-8888-4220-aa3f-c7aeb0bb29da tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:25.095336 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cf833556-8888-4220-aa3f-c7aeb0bb29da tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:25.141731 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e5e2880e-4f2c-4678-800d-a9e3ed12b33b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:25.143137 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e5e2880e-4f2c-4678-800d-a9e3ed12b33b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:25.150326 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e5e2880e-4f2c-4678-800d-a9e3ed12b33b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:25.150940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e5e2880e-4f2c-4678-800d-a9e3ed12b33b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:25.151754 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e5e2880e-4f2c-4678-800d-a9e3ed12b33b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:25.152442 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e5e2880e-4f2c-4678-800d-a9e3ed12b33b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:25.187295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-cf833556-8888-4220-aa3f-c7aeb0bb29da tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cca20d97f474e52bf6581a6a8c57670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572e79ce0a7c49b784aa301e367a176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:25.195870 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-cf833556-8888-4220-aa3f-c7aeb0bb29da tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 200 len: 1299 microversion: 2.1 time: 0.113238 Jun 16 00:29:25.208504 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 239/485] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:25 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:25.307201 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e5e2880e-4f2c-4678-800d-a9e3ed12b33b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:25.314726 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e5e2880e-4f2c-4678-800d-a9e3ed12b33b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.179724 Jun 16 00:29:25.315290 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 247/486] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:25 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:29:26.214158 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6aa4b275-3cd3-40b1-bbc3-8e5d48c1dcf9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:26.215421 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6aa4b275-3cd3-40b1-bbc3-8e5d48c1dcf9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] [instance: fe074b6c-d316-4e61-8478-6c96ecb2dcf9] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:26.222570 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6aa4b275-3cd3-40b1-bbc3-8e5d48c1dcf9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:26.223330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6aa4b275-3cd3-40b1-bbc3-8e5d48c1dcf9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:26.224140 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6aa4b275-3cd3-40b1-bbc3-8e5d48c1dcf9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:26.224569 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6aa4b275-3cd3-40b1-bbc3-8e5d48c1dcf9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:26.238967 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-6aa4b275-3cd3-40b1-bbc3-8e5d48c1dcf9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] HTTP exception thrown: Instance fe074b6c-d316-4e61-8478-6c96ecb2dcf9 could not be found. Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6aa4b275-3cd3-40b1-bbc3-8e5d48c1dcf9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Request method failure captured: Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 HTTP/1.1 Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnjvRiidwmx8bLSB-OCMU8s1Ae73ubMysbiu1yzRqQaLK_Hx5jXAXWmFzl9D0u8qE6gUj67xjrPHjVPLxbOGGU_c02b9RghutnF5Ubh9caySEcE_IT_i2aw_m0mYDkgP6Zxq7i64-g4WEwAUpnDn01x4Dh1sxorwwgLmLxpfm4Laxuc Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 572e79ce0a7c49b784aa301e367a176b Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-VolumesActionsTest-1763182756 Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:29:26.240828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:29:26.242385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/572e79ce0a7c49b784aa301e367a176b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_572e79ce0a7c49b784aa301e367a176b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/572e79ce0a7c49b784aa301e367a176b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/572e79ce0a7c49b784aa301e367a176b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:29:26.242385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-VolumesActionsTest-1763182756 Jun 16 00:29:26.242385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 572e79ce0a7c49b784aa301e367a176b Jun 16 00:29:26.242385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-VolumesActionsTest-1763182756 Jun 16 00:29:26.242385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-VolumesActionsTest-1763182756-project Jun 16 00:29:26.242385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:29:26.242385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:29:26.242385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: 4cca20d97f474e52bf6581a6a8c57670 Jun 16 00:29:26.242385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-VolumesActionsTest-1763182756-project Jun 16 00:29:26.242385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:29:26.242385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance fe074b6c-d316-4e61-8478-6c96ecb2dcf9 could not be found. Jun 16 00:29:26.242385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': 'fe074b6c-d316-4e61-8478-6c96ecb2dcf9'} Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe074b6c-d316-4e61-8478-6c96ecb2dcf9 could not be found. Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:29:26.243269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe074b6c-d316-4e61-8478-6c96ecb2dcf9 could not be found. Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe074b6c-d316-4e61-8478-6c96ecb2dcf9 could not be found. Jun 16 00:29:26.244920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:29:26.246139 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6aa4b275-3cd3-40b1-bbc3-8e5d48c1dcf9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] Returning 404 to user: Instance fe074b6c-d316-4e61-8478-6c96ecb2dcf9 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:29:26.246139 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6aa4b275-3cd3-40b1-bbc3-8e5d48c1dcf9 tempest-VolumesActionsTest-1763182756 tempest-VolumesActionsTest-1763182756-project] 10.222.0.44 "GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9" status: 404 len: 111 microversion: 2.1 time: 0.031985 Jun 16 00:29:26.246139 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 240/487] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:26 2022] GET /compute/v2.1/servers/fe074b6c-d316-4e61-8478-6c96ecb2dcf9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:29:26.332100 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4a9ef462-be96-4a6c-96a1-7d433d7074b7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:26.334570 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4a9ef462-be96-4a6c-96a1-7d433d7074b7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:26.344065 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4a9ef462-be96-4a6c-96a1-7d433d7074b7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:26.344516 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4a9ef462-be96-4a6c-96a1-7d433d7074b7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:26.345315 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4a9ef462-be96-4a6c-96a1-7d433d7074b7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:26.345906 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4a9ef462-be96-4a6c-96a1-7d433d7074b7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:26.490513 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4a9ef462-be96-4a6c-96a1-7d433d7074b7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:26.498954 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4a9ef462-be96-4a6c-96a1-7d433d7074b7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.171026 Jun 16 00:29:26.499602 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 248/488] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:26 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:27.516339 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a90f1be3-b76f-4b55-9d77-118a1560b5e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:27.516936 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a90f1be3-b76f-4b55-9d77-118a1560b5e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:27.523001 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a90f1be3-b76f-4b55-9d77-118a1560b5e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:27.523440 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a90f1be3-b76f-4b55-9d77-118a1560b5e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:27.524236 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a90f1be3-b76f-4b55-9d77-118a1560b5e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:27.524668 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a90f1be3-b76f-4b55-9d77-118a1560b5e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:27.655585 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a90f1be3-b76f-4b55-9d77-118a1560b5e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:27.662959 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a90f1be3-b76f-4b55-9d77-118a1560b5e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.150705 Jun 16 00:29:27.663509 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 241/489] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:27 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:28.679990 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1f3e8b1e-7b4d-475e-854b-0e3978ad60d5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:28.680616 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1f3e8b1e-7b4d-475e-854b-0e3978ad60d5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:28.687760 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1f3e8b1e-7b4d-475e-854b-0e3978ad60d5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:28.688202 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1f3e8b1e-7b4d-475e-854b-0e3978ad60d5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:28.688957 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1f3e8b1e-7b4d-475e-854b-0e3978ad60d5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:28.689385 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1f3e8b1e-7b4d-475e-854b-0e3978ad60d5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:28.819650 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1f3e8b1e-7b4d-475e-854b-0e3978ad60d5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:28.827024 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1f3e8b1e-7b4d-475e-854b-0e3978ad60d5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.150855 Jun 16 00:29:28.827582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 249/490] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:28 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:29.844535 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-11d4521d-9f96-441b-8167-6e432440f73b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:29.845105 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-11d4521d-9f96-441b-8167-6e432440f73b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:29.851226 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-11d4521d-9f96-441b-8167-6e432440f73b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:29.851688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-11d4521d-9f96-441b-8167-6e432440f73b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:29.852451 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-11d4521d-9f96-441b-8167-6e432440f73b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:29.852878 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-11d4521d-9f96-441b-8167-6e432440f73b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:29.980007 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-11d4521d-9f96-441b-8167-6e432440f73b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:29.987320 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-11d4521d-9f96-441b-8167-6e432440f73b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.147396 Jun 16 00:29:29.987911 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 242/491] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:29 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:31.005149 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-bcaf85fc-ac96-47c7-ae99-d11a5d5edd78 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:31.005887 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-bcaf85fc-ac96-47c7-ae99-d11a5d5edd78 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:31.012597 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bcaf85fc-ac96-47c7-ae99-d11a5d5edd78 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:31.013048 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bcaf85fc-ac96-47c7-ae99-d11a5d5edd78 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:31.014764 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bcaf85fc-ac96-47c7-ae99-d11a5d5edd78 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:31.015203 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bcaf85fc-ac96-47c7-ae99-d11a5d5edd78 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:31.147707 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-bcaf85fc-ac96-47c7-ae99-d11a5d5edd78 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:31.155173 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-bcaf85fc-ac96-47c7-ae99-d11a5d5edd78 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.154222 Jun 16 00:29:31.155763 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 250/492] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:30 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:32.171745 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6c74b9d8-04f1-47ca-9e80-e8344aee44a0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:32.172356 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6c74b9d8-04f1-47ca-9e80-e8344aee44a0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:32.174319 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=68 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:32.179893 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6c74b9d8-04f1-47ca-9e80-e8344aee44a0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:32.180346 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6c74b9d8-04f1-47ca-9e80-e8344aee44a0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:32.181114 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6c74b9d8-04f1-47ca-9e80-e8344aee44a0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:32.181550 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6c74b9d8-04f1-47ca-9e80-e8344aee44a0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:32.307128 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6c74b9d8-04f1-47ca-9e80-e8344aee44a0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:32.314407 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6c74b9d8-04f1-47ca-9e80-e8344aee44a0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.146576 Jun 16 00:29:32.314956 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 243/493] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:32 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:32.389308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:29:32.389734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Thu Jun 16 00:29:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:29:33.329950 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8bb0089b-997e-491e-9a94-3d6cec442e20 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:33.330554 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8bb0089b-997e-491e-9a94-3d6cec442e20 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:33.332901 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=64 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:33.338018 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8bb0089b-997e-491e-9a94-3d6cec442e20 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:33.338462 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8bb0089b-997e-491e-9a94-3d6cec442e20 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:33.339219 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8bb0089b-997e-491e-9a94-3d6cec442e20 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:33.339675 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8bb0089b-997e-491e-9a94-3d6cec442e20 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:33.678298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8bb0089b-997e-491e-9a94-3d6cec442e20 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:33.686273 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8bb0089b-997e-491e-9a94-3d6cec442e20 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.359985 Jun 16 00:29:33.686837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 251/494] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:33 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:34.380263 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-65dd82b3-b57f-45b6-98dd-5162ae1fb54b req-deee774d-9fd6-4bb5-a3f1-a22510737f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3f55ea4-7849-4165-9708-f6e0925a32e8", "name": "network-vif-plugged", "status": "completed", "tag": "ee01316d-3ff6-4e30-aa8e-9bdb422b6864"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:34.388556 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-65dd82b3-b57f-45b6-98dd-5162ae1fb54b req-deee774d-9fd6-4bb5-a3f1-a22510737f12 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:34.389326 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-65dd82b3-b57f-45b6-98dd-5162ae1fb54b req-deee774d-9fd6-4bb5-a3f1-a22510737f12 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:34.400627 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-65dd82b3-b57f-45b6-98dd-5162ae1fb54b req-deee774d-9fd6-4bb5-a3f1-a22510737f12 service nova] Creating event network-vif-plugged:ee01316d-3ff6-4e30-aa8e-9bdb422b6864 for instance c3f55ea4-7849-4165-9708-f6e0925a32e8 on hv-cinder-84327 Jun 16 00:29:34.405531 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-65dd82b3-b57f-45b6-98dd-5162ae1fb54b req-deee774d-9fd6-4bb5-a3f1-a22510737f12 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029223 Jun 16 00:29:34.406112 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 244/495] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:34.703232 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b8731bb9-6035-4328-8786-5b0c0acba7e9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:34.703805 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b8731bb9-6035-4328-8786-5b0c0acba7e9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:34.710174 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b8731bb9-6035-4328-8786-5b0c0acba7e9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:34.710618 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b8731bb9-6035-4328-8786-5b0c0acba7e9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:34.711368 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b8731bb9-6035-4328-8786-5b0c0acba7e9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:34.711824 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b8731bb9-6035-4328-8786-5b0c0acba7e9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:34.845336 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b8731bb9-6035-4328-8786-5b0c0acba7e9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:34.847517 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=100 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:34.854101 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b8731bb9-6035-4328-8786-5b0c0acba7e9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.154769 Jun 16 00:29:34.854652 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 252/496] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:34 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:35.871884 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-400a4da8-258d-4c47-80e9-70a7f4545eba tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:35.872507 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-400a4da8-258d-4c47-80e9-70a7f4545eba tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:35.878608 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-400a4da8-258d-4c47-80e9-70a7f4545eba tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:35.879048 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-400a4da8-258d-4c47-80e9-70a7f4545eba tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:35.879828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-400a4da8-258d-4c47-80e9-70a7f4545eba tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:35.880256 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-400a4da8-258d-4c47-80e9-70a7f4545eba tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:36.009748 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-400a4da8-258d-4c47-80e9-70a7f4545eba tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:36.017801 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-400a4da8-258d-4c47-80e9-70a7f4545eba tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.150204 Jun 16 00:29:36.018350 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 245/497] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:35 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:37.034865 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-63327ec5-e72f-41b7-bcca-d46ae9f526de tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:37.035472 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-63327ec5-e72f-41b7-bcca-d46ae9f526de tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:37.041999 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63327ec5-e72f-41b7-bcca-d46ae9f526de tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:37.042442 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63327ec5-e72f-41b7-bcca-d46ae9f526de tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:37.043208 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63327ec5-e72f-41b7-bcca-d46ae9f526de tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:37.043663 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63327ec5-e72f-41b7-bcca-d46ae9f526de tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:37.171704 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-63327ec5-e72f-41b7-bcca-d46ae9f526de tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:37.179005 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-63327ec5-e72f-41b7-bcca-d46ae9f526de tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.148111 Jun 16 00:29:37.179556 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 253/498] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:37 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:38.195122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-57478a9f-b974-4c92-a615-936413b19b57 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:38.195683 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-57478a9f-b974-4c92-a615-936413b19b57 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:38.202351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-57478a9f-b974-4c92-a615-936413b19b57 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:38.202828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-57478a9f-b974-4c92-a615-936413b19b57 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:38.203587 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-57478a9f-b974-4c92-a615-936413b19b57 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:38.204037 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-57478a9f-b974-4c92-a615-936413b19b57 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:38.336444 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-57478a9f-b974-4c92-a615-936413b19b57 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:38.344367 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-57478a9f-b974-4c92-a615-936413b19b57 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.153210 Jun 16 00:29:38.344910 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 246/499] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:38 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:39.361459 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-662a4e37-0686-4130-831f-f5e6d40704a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:39.362071 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-662a4e37-0686-4130-831f-f5e6d40704a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:39.368480 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-662a4e37-0686-4130-831f-f5e6d40704a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:39.368930 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-662a4e37-0686-4130-831f-f5e6d40704a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:39.369695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-662a4e37-0686-4130-831f-f5e6d40704a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:39.370132 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-662a4e37-0686-4130-831f-f5e6d40704a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:39.498840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-662a4e37-0686-4130-831f-f5e6d40704a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:39.506266 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-662a4e37-0686-4130-831f-f5e6d40704a5 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.149374 Jun 16 00:29:39.506818 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 254/500] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:39 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:40.523830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1f10c30a-6258-44ed-b390-ae96dc61bcbd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:40.524429 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1f10c30a-6258-44ed-b390-ae96dc61bcbd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:40.531676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1f10c30a-6258-44ed-b390-ae96dc61bcbd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:40.532121 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1f10c30a-6258-44ed-b390-ae96dc61bcbd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:40.532868 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1f10c30a-6258-44ed-b390-ae96dc61bcbd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:40.533296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1f10c30a-6258-44ed-b390-ae96dc61bcbd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:40.664843 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1f10c30a-6258-44ed-b390-ae96dc61bcbd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:40.673132 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1f10c30a-6258-44ed-b390-ae96dc61bcbd tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.153044 Jun 16 00:29:40.673712 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 247/501] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:40 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:41.689646 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8a383826-14d7-4b16-a0eb-a48dbf00b852 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:41.690185 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8a383826-14d7-4b16-a0eb-a48dbf00b852 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:41.696915 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8a383826-14d7-4b16-a0eb-a48dbf00b852 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:41.697396 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8a383826-14d7-4b16-a0eb-a48dbf00b852 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:41.698233 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8a383826-14d7-4b16-a0eb-a48dbf00b852 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:41.698666 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8a383826-14d7-4b16-a0eb-a48dbf00b852 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:41.826462 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8a383826-14d7-4b16-a0eb-a48dbf00b852 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:41.834394 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8a383826-14d7-4b16-a0eb-a48dbf00b852 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.148620 Jun 16 00:29:41.834955 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 255/502] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:41 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:42.851502 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c09b4bcf-25a1-4982-8241-ad7a37a533a6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:42.852155 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c09b4bcf-25a1-4982-8241-ad7a37a533a6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:42.858693 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c09b4bcf-25a1-4982-8241-ad7a37a533a6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:42.859145 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c09b4bcf-25a1-4982-8241-ad7a37a533a6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:42.859945 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c09b4bcf-25a1-4982-8241-ad7a37a533a6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:42.860384 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c09b4bcf-25a1-4982-8241-ad7a37a533a6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:42.990981 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c09b4bcf-25a1-4982-8241-ad7a37a533a6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:42.998402 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c09b4bcf-25a1-4982-8241-ad7a37a533a6 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.150709 Jun 16 00:29:42.998922 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 248/503] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:42 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:44.014824 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-408dc6d6-17a4-460d-acc4-07852bc1622e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:44.015434 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-408dc6d6-17a4-460d-acc4-07852bc1622e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:44.021570 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-408dc6d6-17a4-460d-acc4-07852bc1622e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:44.022012 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-408dc6d6-17a4-460d-acc4-07852bc1622e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:44.022773 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-408dc6d6-17a4-460d-acc4-07852bc1622e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:44.023207 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-408dc6d6-17a4-460d-acc4-07852bc1622e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:44.152906 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-408dc6d6-17a4-460d-acc4-07852bc1622e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:44.160952 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-408dc6d6-17a4-460d-acc4-07852bc1622e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.150730 Jun 16 00:29:44.161514 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 256/504] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:44 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:45.177605 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6b3bfeca-c66c-4797-b627-fe44a06085e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:45.178215 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6b3bfeca-c66c-4797-b627-fe44a06085e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:45.184186 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6b3bfeca-c66c-4797-b627-fe44a06085e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:45.184635 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6b3bfeca-c66c-4797-b627-fe44a06085e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:45.185420 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6b3bfeca-c66c-4797-b627-fe44a06085e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:45.185853 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6b3bfeca-c66c-4797-b627-fe44a06085e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:45.309897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6b3bfeca-c66c-4797-b627-fe44a06085e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:45.317784 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6b3bfeca-c66c-4797-b627-fe44a06085e0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.144011 Jun 16 00:29:45.318337 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 249/505] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:45 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:46.334253 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8c5a67da-e380-416e-83dd-2e46c4d77a33 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:46.334861 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8c5a67da-e380-416e-83dd-2e46c4d77a33 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:46.344004 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c5a67da-e380-416e-83dd-2e46c4d77a33 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:46.344452 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c5a67da-e380-416e-83dd-2e46c4d77a33 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:46.345222 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c5a67da-e380-416e-83dd-2e46c4d77a33 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:46.345655 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c5a67da-e380-416e-83dd-2e46c4d77a33 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:46.479411 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8c5a67da-e380-416e-83dd-2e46c4d77a33 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:46.487014 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8c5a67da-e380-416e-83dd-2e46c4d77a33 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1359 microversion: 2.1 time: 0.156496 Jun 16 00:29:46.487603 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 257/506] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:46 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:47.504394 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0cf424c6-4dc6-4edf-a114-512f14f789ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:47.505162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0cf424c6-4dc6-4edf-a114-512f14f789ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:47.511635 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0cf424c6-4dc6-4edf-a114-512f14f789ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.512144 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0cf424c6-4dc6-4edf-a114-512f14f789ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:47.512939 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0cf424c6-4dc6-4edf-a114-512f14f789ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.513425 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0cf424c6-4dc6-4edf-a114-512f14f789ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:47.642169 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0cf424c6-4dc6-4edf-a114-512f14f789ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:47.650244 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0cf424c6-4dc6-4edf-a114-512f14f789ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1547 microversion: 2.1 time: 0.149948 Jun 16 00:29:47.650807 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 250/507] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:47 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:47.667096 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-17ae6c56-124b-4a47-827f-cb1e5d1fc390 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:47.667772 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-17ae6c56-124b-4a47-827f-cb1e5d1fc390 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:47.674277 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-17ae6c56-124b-4a47-827f-cb1e5d1fc390 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.674989 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-17ae6c56-124b-4a47-827f-cb1e5d1fc390 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:47.675800 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-17ae6c56-124b-4a47-827f-cb1e5d1fc390 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.676240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-17ae6c56-124b-4a47-827f-cb1e5d1fc390 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:47.812078 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-17ae6c56-124b-4a47-827f-cb1e5d1fc390 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:47.819479 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-17ae6c56-124b-4a47-827f-cb1e5d1fc390 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1547 microversion: 2.1 time: 0.156200 Jun 16 00:29:47.820158 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 258/508] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:47 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:47.835764 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b692067f-f582-49a2-91b1-dc66fea7f126 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:47.839008 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b692067f-f582-49a2-91b1-dc66fea7f126 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:47.839802 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b692067f-f582-49a2-91b1-dc66fea7f126 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Searching by: {'deleted': False, 'project_id': '4b5ec212032a46aab16a55fde900c916'} {{(pid=129465) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 00:29:47.846749 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b692067f-f582-49a2-91b1-dc66fea7f126 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.847206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b692067f-f582-49a2-91b1-dc66fea7f126 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:47.848028 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b692067f-f582-49a2-91b1-dc66fea7f126 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:47.848521 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b692067f-f582-49a2-91b1-dc66fea7f126 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:47.941426 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.multi_cell_list [None req-b692067f-f582-49a2-91b1-dc66fea7f126 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129465) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 00:29:47.968443 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=100 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:48.042279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b692067f-f582-49a2-91b1-dc66fea7f126 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210608 Jun 16 00:29:48.043029 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 251/509] 10.222.0.44 () {58 vars in 1124 bytes} [Thu Jun 16 00:29:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:48.055318 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b3db8c36-8674-4d00-861c-e7b5cf0cd6c0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:48.055988 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b3db8c36-8674-4d00-861c-e7b5cf0cd6c0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:48.063184 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b3db8c36-8674-4d00-861c-e7b5cf0cd6c0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:48.063647 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b3db8c36-8674-4d00-861c-e7b5cf0cd6c0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:48.064596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b3db8c36-8674-4d00-861c-e7b5cf0cd6c0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:48.065032 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b3db8c36-8674-4d00-861c-e7b5cf0cd6c0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:48.218378 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b3db8c36-8674-4d00-861c-e7b5cf0cd6c0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:29:48.227189 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b3db8c36-8674-4d00-861c-e7b5cf0cd6c0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1547 microversion: 2.1 time: 0.176250 Jun 16 00:29:48.228232 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 259/510] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:29:48 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1547 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:50.885755 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-25bc6537-7dae-490d-afae-1fc2e3eb0adb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da005172-239c-4d30-89fe-e6e92e30cc2d"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:29:50.886807 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-25bc6537-7dae-490d-afae-1fc2e3eb0adb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:29:50.893172 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-25bc6537-7dae-490d-afae-1fc2e3eb0adb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:50.893648 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-25bc6537-7dae-490d-afae-1fc2e3eb0adb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:50.894431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-25bc6537-7dae-490d-afae-1fc2e3eb0adb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:29:50.894866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-25bc6537-7dae-490d-afae-1fc2e3eb0adb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:29:51.198902 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-25bc6537-7dae-490d-afae-1fc2e3eb0adb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "POST /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316903 Jun 16 00:29:51.199573 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 252/511] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:29:50 2022] POST /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:00.224503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-79e987c3-2b85-4bad-a22b-95c50ee3b6cb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:00.225092 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-79e987c3-2b85-4bad-a22b-95c50ee3b6cb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:00.231170 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=17 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:00.231851 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=43 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:00.238933 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-79e987c3-2b85-4bad-a22b-95c50ee3b6cb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:00.239266 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-79e987c3-2b85-4bad-a22b-95c50ee3b6cb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:00.247184 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-79e987c3-2b85-4bad-a22b-95c50ee3b6cb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:00.247667 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-79e987c3-2b85-4bad-a22b-95c50ee3b6cb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:00.495794 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-79e987c3-2b85-4bad-a22b-95c50ee3b6cb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:00.507771 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-79e987c3-2b85-4bad-a22b-95c50ee3b6cb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1593 microversion: 2.1 time: 0.289336 Jun 16 00:30:00.509872 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 260/512] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:00 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1593 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:04.944669 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-56ae3165-e162-4939-9eb2-89f360dd414e req-466441bd-4045-4d57-a2c7-e226226cfede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f55ea4-7849-4165-9708-f6e0925a32e8", "tag": "ee01316d-3ff6-4e30-aa8e-9bdb422b6864"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:04.950158 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:04.950888 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=19 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:04.957039 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:04.975028 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-56ae3165-e162-4939-9eb2-89f360dd414e req-466441bd-4045-4d57-a2c7-e226226cfede service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:04.975749 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-56ae3165-e162-4939-9eb2-89f360dd414e req-466441bd-4045-4d57-a2c7-e226226cfede service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:05.014493 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-56ae3165-e162-4939-9eb2-89f360dd414e req-466441bd-4045-4d57-a2c7-e226226cfede service nova] Creating event network-changed:ee01316d-3ff6-4e30-aa8e-9bdb422b6864 for instance c3f55ea4-7849-4165-9708-f6e0925a32e8 on hv-cinder-84327 Jun 16 00:30:05.040136 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-56ae3165-e162-4939-9eb2-89f360dd414e req-466441bd-4045-4d57-a2c7-e226226cfede service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096373 Jun 16 00:30:05.046685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 253/513] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:07.540350 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ed023b71-4167-4b4b-8ff6-c78e9f628437 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-519064835"}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:07.541654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ed023b71-4167-4b4b-8ff6-c78e9f628437 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:07.558723 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ed023b71-4167-4b4b-8ff6-c78e9f628437 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:07.559483 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ed023b71-4167-4b4b-8ff6-c78e9f628437 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:07.563416 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ed023b71-4167-4b4b-8ff6-c78e9f628437 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:07.564060 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ed023b71-4167-4b4b-8ff6-c78e9f628437 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:08.029089 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.network.security_group_api [None req-ed023b71-4167-4b4b-8ff6-c78e9f628437 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Adding security group 928ec3cb-115a-4f28-a97d-34dcb560ac4b to port ee01316d-3ff6-4e30-aa8e-9bdb422b6864 Jun 16 00:30:08.614943 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2d400482-a1a6-4dd9-940c-541ea6dcbb9b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Action: 'create', calling method: .version_select at 0x7f958054a430>, body: {"keypair": {"name": "tempest-TestShelveInstance-46501161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFkYvk/h2joAi67CSHSslqNsVRM5wPkg1Tnggj+27sU+fBWTvE2q07BOHpvXtoczgsOVVWzAQ0Zy7L5LmYfj+p4HJPVJtjufaj67QfX5udA9Qi9BiGmA8ziXpe89McIoQ=="}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:08.640504 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-2d400482-a1a6-4dd9-940c-541ea6dcbb9b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Getting quotas for project c645f5673fe144de9432ba22b7d5ae87. Resources: {'key_pairs'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:30:08.645533 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-2d400482-a1a6-4dd9-940c-541ea6dcbb9b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Getting quotas for user cff74fa58ac342228f9f5235347bf6bb and project c645f5673fe144de9432ba22b7d5ae87. Resources: {'key_pairs'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:30:08.685471 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2d400482-a1a6-4dd9-940c-541ea6dcbb9b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.481625 Jun 16 00:30:08.686913 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 254/514] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 16 00:30:08 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:08.747038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ed023b71-4167-4b4b-8ff6-c78e9f628437 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "POST /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/action" status: 202 len: 0 microversion: 2.1 time: 1.214216 Jun 16 00:30:08.747827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 261/515] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:30:07 2022] POST /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/action => generated 0 bytes in 1217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:30:08.756991 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b52aae1b-9201-4ece-bceb-9baf6aa8f2ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:08.757661 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b52aae1b-9201-4ece-bceb-9baf6aa8f2ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:08.775863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-6f84f9ad-7048-456c-9f15-486c620ffc3a req-3e1dfed5-6e05-4763-87c2-3ea53a97a054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f55ea4-7849-4165-9708-f6e0925a32e8", "tag": "ee01316d-3ff6-4e30-aa8e-9bdb422b6864"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:08.782957 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b52aae1b-9201-4ece-bceb-9baf6aa8f2ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:08.793056 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b52aae1b-9201-4ece-bceb-9baf6aa8f2ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:08.794332 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b52aae1b-9201-4ece-bceb-9baf6aa8f2ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:08.797415 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b52aae1b-9201-4ece-bceb-9baf6aa8f2ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:08.801170 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-6f84f9ad-7048-456c-9f15-486c620ffc3a req-3e1dfed5-6e05-4763-87c2-3ea53a97a054 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:08.801631 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-6f84f9ad-7048-456c-9f15-486c620ffc3a req-3e1dfed5-6e05-4763-87c2-3ea53a97a054 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:08.842881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-6f84f9ad-7048-456c-9f15-486c620ffc3a req-3e1dfed5-6e05-4763-87c2-3ea53a97a054 service nova] Creating event network-changed:ee01316d-3ff6-4e30-aa8e-9bdb422b6864 for instance c3f55ea4-7849-4165-9708-f6e0925a32e8 on hv-cinder-84327 Jun 16 00:30:08.866442 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-6f84f9ad-7048-456c-9f15-486c620ffc3a req-3e1dfed5-6e05-4763-87c2-3ea53a97a054 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095261 Jun 16 00:30:08.875724 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 262/516] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:09.202593 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b52aae1b-9201-4ece-bceb-9baf6aa8f2ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:09.226020 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b52aae1b-9201-4ece-bceb-9baf6aa8f2ad tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1758 microversion: 2.1 time: 0.472704 Jun 16 00:30:09.244192 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 255/517] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:08 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1758 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:34.584098 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-021c2875-e5da-44f0-904a-b20087b95d71 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:34.584678 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-021c2875-e5da-44f0-904a-b20087b95d71 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:34.586916 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=6 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:34.587696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=12 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:34.594245 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-021c2875-e5da-44f0-904a-b20087b95d71 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:34.594691 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-021c2875-e5da-44f0-904a-b20087b95d71 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:34.595453 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-021c2875-e5da-44f0-904a-b20087b95d71 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:34.595922 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-021c2875-e5da-44f0-904a-b20087b95d71 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:34.618350 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-021c2875-e5da-44f0-904a-b20087b95d71 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/ips" status: 200 len: 151 microversion: 2.20 time: 0.038460 Jun 16 00:30:34.618903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 263/518] 10.222.0.44 () {60 vars in 1288 bytes} [Thu Jun 16 00:30:34 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:30:36.605938 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-487615251", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-46501161", "security_groups": [{"name": "tempest-secgroup-smoke-1834766173"}], "networks": [{"uuid": "69891ea1-5d4b-4c37-b2b3-ed70363e87db"}], "block_device_mapping_v2": [{"uuid": "859186f8-2781-42f9-ab1a-7b4eb132ef04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:36.616316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=4 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:36.616955 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:36.617740 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=8 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:36.722580 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] validate_networks() for [('69891ea1-5d4b-4c37-b2b3-ed70363e87db', None, None, None, None, None)] {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:30:37.288902 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:30:37.289328 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:30:37.289791 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:30:37.290192 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:30:37.290594 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:30:37.302562 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:37.302997 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:37.303817 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:37.304246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:37.321636 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Getting quotas for project c645f5673fe144de9432ba22b7d5ae87. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:30:37.325513 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Getting quotas for user cff74fa58ac342228f9f5235347bf6bb and project c645f5673fe144de9432ba22b7d5ae87. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:30:37.385299 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:30:37.387379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='859186f8-2781-42f9-ab1a-7b4eb132ef04',volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:30:37.504465 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-41b6350b-a2b2-448b-8fb5-15396ab845fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:37.505381 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-41b6350b-a2b2-448b-8fb5-15396ab845fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:37.513012 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-41b6350b-a2b2-448b-8fb5-15396ab845fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:37.513459 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-41b6350b-a2b2-448b-8fb5-15396ab845fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:37.514226 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-41b6350b-a2b2-448b-8fb5-15396ab845fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:37.514691 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-41b6350b-a2b2-448b-8fb5-15396ab845fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:37.518157 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4a9a6fcf-8ddf-439e-83c8-eb97f39aa0cb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.916081 Jun 16 00:30:37.519010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 256/519] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:30:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:30:37.529028 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7fbb4fa5-abe0-4776-94d9-d6978e2ddaf4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:37.530539 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7fbb4fa5-abe0-4776-94d9-d6978e2ddaf4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:37.542847 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.objects.instance [None req-41b6350b-a2b2-448b-8fb5-15396ab845fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lazy-loading 'flavor' on Instance uuid 7b84afb6-466c-477a-9339-b4a0ecef36be {{(pid=129466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:30:37.592515 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7fbb4fa5-abe0-4776-94d9-d6978e2ddaf4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:37.600043 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7fbb4fa5-abe0-4776-94d9-d6978e2ddaf4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1086 microversion: 2.1 time: 0.075217 Jun 16 00:30:37.603661 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 257/520] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:37 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1086 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:37.864991 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-41b6350b-a2b2-448b-8fb5-15396ab845fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "POST /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/action" status: 202 len: 0 microversion: 2.20 time: 0.366487 Jun 16 00:30:37.868671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 264/521] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jun 16 00:30:37 2022] POST /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:30:37.875398 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-945312f6-66d8-447e-b6a2-aedf8f6baf23 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:37.876297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-945312f6-66d8-447e-b6a2-aedf8f6baf23 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:37.889454 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-945312f6-66d8-447e-b6a2-aedf8f6baf23 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:37.889897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-945312f6-66d8-447e-b6a2-aedf8f6baf23 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:37.890780 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-945312f6-66d8-447e-b6a2-aedf8f6baf23 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:37.891279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-945312f6-66d8-447e-b6a2-aedf8f6baf23 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:38.025703 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-945312f6-66d8-447e-b6a2-aedf8f6baf23 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:38.034308 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-945312f6-66d8-447e-b6a2-aedf8f6baf23 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:38.035818 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-945312f6-66d8-447e-b6a2-aedf8f6baf23 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:38.037063 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-945312f6-66d8-447e-b6a2-aedf8f6baf23 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.166739 Jun 16 00:30:38.037616 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 258/522] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:37 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:38.618460 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7d4efb77-a151-46af-96a6-8fa343341288 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:38.619161 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7d4efb77-a151-46af-96a6-8fa343341288 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:38.626070 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7d4efb77-a151-46af-96a6-8fa343341288 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:38.626521 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7d4efb77-a151-46af-96a6-8fa343341288 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:38.627291 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7d4efb77-a151-46af-96a6-8fa343341288 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:38.627772 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7d4efb77-a151-46af-96a6-8fa343341288 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:38.689594 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7d4efb77-a151-46af-96a6-8fa343341288 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:38.697154 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7d4efb77-a151-46af-96a6-8fa343341288 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1184 microversion: 2.1 time: 0.083334 Jun 16 00:30:38.697932 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 265/523] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:38 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1184 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:39.055482 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-229acdb4-79b5-417f-8f29-4777f297af0d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:39.056103 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-229acdb4-79b5-417f-8f29-4777f297af0d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:39.063118 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-229acdb4-79b5-417f-8f29-4777f297af0d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:39.063573 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-229acdb4-79b5-417f-8f29-4777f297af0d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:39.064371 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-229acdb4-79b5-417f-8f29-4777f297af0d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:39.065034 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-229acdb4-79b5-417f-8f29-4777f297af0d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:39.205092 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-229acdb4-79b5-417f-8f29-4777f297af0d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:39.213509 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-229acdb4-79b5-417f-8f29-4777f297af0d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:39.215015 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-229acdb4-79b5-417f-8f29-4777f297af0d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:39.216227 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-229acdb4-79b5-417f-8f29-4777f297af0d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.164621 Jun 16 00:30:39.216852 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 259/524] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:39 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:39.719562 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e6fd51d5-f94f-422c-a607-f779ef2f94cd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:39.721063 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e6fd51d5-f94f-422c-a607-f779ef2f94cd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:39.728834 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e6fd51d5-f94f-422c-a607-f779ef2f94cd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:39.730209 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e6fd51d5-f94f-422c-a607-f779ef2f94cd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:39.731327 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e6fd51d5-f94f-422c-a607-f779ef2f94cd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:39.731962 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e6fd51d5-f94f-422c-a607-f779ef2f94cd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:39.879401 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e6fd51d5-f94f-422c-a607-f779ef2f94cd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:39.887051 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e6fd51d5-f94f-422c-a607-f779ef2f94cd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1270 microversion: 2.1 time: 0.176425 Jun 16 00:30:39.887642 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 266/525] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:39 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:40.235777 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e97bb8a4-7493-4a48-911e-1e2d9b82d309 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:40.236410 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e97bb8a4-7493-4a48-911e-1e2d9b82d309 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:40.242577 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e97bb8a4-7493-4a48-911e-1e2d9b82d309 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:40.243281 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e97bb8a4-7493-4a48-911e-1e2d9b82d309 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:40.244087 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e97bb8a4-7493-4a48-911e-1e2d9b82d309 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:40.244679 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e97bb8a4-7493-4a48-911e-1e2d9b82d309 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:40.385483 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e97bb8a4-7493-4a48-911e-1e2d9b82d309 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:40.394633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e97bb8a4-7493-4a48-911e-1e2d9b82d309 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:40.396575 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e97bb8a4-7493-4a48-911e-1e2d9b82d309 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:40.398082 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e97bb8a4-7493-4a48-911e-1e2d9b82d309 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.166807 Jun 16 00:30:40.399104 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 260/526] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:40 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:40.399851 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-b466d731-adbd-4dfb-818a-c50563b721d1 req-baa6addd-48fe-408c-b64a-e5e854523a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb151dc-a559-4ad5-9a4f-c55e2609758f", "tag": "bf8752fe-370d-4c67-8d58-5ab0ba31fdc9"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:40.410925 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-b466d731-adbd-4dfb-818a-c50563b721d1 req-baa6addd-48fe-408c-b64a-e5e854523a11 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:40.411374 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-b466d731-adbd-4dfb-818a-c50563b721d1 req-baa6addd-48fe-408c-b64a-e5e854523a11 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:40.425677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-b466d731-adbd-4dfb-818a-c50563b721d1 req-baa6addd-48fe-408c-b64a-e5e854523a11 service nova] Creating event network-changed:bf8752fe-370d-4c67-8d58-5ab0ba31fdc9 for instance ebb151dc-a559-4ad5-9a4f-c55e2609758f on hv-cinder-84327 Jun 16 00:30:40.430588 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-b466d731-adbd-4dfb-818a-c50563b721d1 req-baa6addd-48fe-408c-b64a-e5e854523a11 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034868 Jun 16 00:30:40.431332 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 267/527] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:40.904229 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a6c73bda-4164-46d6-a9b4-67a418f919f1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:40.904823 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a6c73bda-4164-46d6-a9b4-67a418f919f1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:40.911481 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a6c73bda-4164-46d6-a9b4-67a418f919f1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:40.911960 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a6c73bda-4164-46d6-a9b4-67a418f919f1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:40.913336 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a6c73bda-4164-46d6-a9b4-67a418f919f1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:40.913967 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a6c73bda-4164-46d6-a9b4-67a418f919f1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:41.043169 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a6c73bda-4164-46d6-a9b4-67a418f919f1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:41.051124 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a6c73bda-4164-46d6-a9b4-67a418f919f1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.150692 Jun 16 00:30:41.051710 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 261/528] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:40 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:41.417659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a11f2fd9-3e3c-4c63-89c4-fe0f361fa74b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:41.418301 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a11f2fd9-3e3c-4c63-89c4-fe0f361fa74b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:41.424472 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a11f2fd9-3e3c-4c63-89c4-fe0f361fa74b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:41.424921 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a11f2fd9-3e3c-4c63-89c4-fe0f361fa74b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:41.425681 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a11f2fd9-3e3c-4c63-89c4-fe0f361fa74b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:41.426115 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a11f2fd9-3e3c-4c63-89c4-fe0f361fa74b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:41.554112 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a11f2fd9-3e3c-4c63-89c4-fe0f361fa74b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:41.562499 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a11f2fd9-3e3c-4c63-89c4-fe0f361fa74b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:41.564028 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a11f2fd9-3e3c-4c63-89c4-fe0f361fa74b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:41.565182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a11f2fd9-3e3c-4c63-89c4-fe0f361fa74b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.152306 Jun 16 00:30:41.565739 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 268/529] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:41 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:42.067501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-18c954ec-3d3b-4797-a2e1-1c528179675c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:42.068206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-18c954ec-3d3b-4797-a2e1-1c528179675c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:42.074868 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-18c954ec-3d3b-4797-a2e1-1c528179675c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:42.075348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-18c954ec-3d3b-4797-a2e1-1c528179675c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:42.076128 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-18c954ec-3d3b-4797-a2e1-1c528179675c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:42.076556 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-18c954ec-3d3b-4797-a2e1-1c528179675c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:42.209124 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-18c954ec-3d3b-4797-a2e1-1c528179675c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:42.216661 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-18c954ec-3d3b-4797-a2e1-1c528179675c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.152982 Jun 16 00:30:42.217236 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 262/530] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:42 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:42.583200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0698d9a5-52f7-4132-9162-188e0a8bd7fe tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:42.583796 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0698d9a5-52f7-4132-9162-188e0a8bd7fe tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:42.589807 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0698d9a5-52f7-4132-9162-188e0a8bd7fe tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:42.590260 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0698d9a5-52f7-4132-9162-188e0a8bd7fe tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:42.591016 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0698d9a5-52f7-4132-9162-188e0a8bd7fe tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:42.591449 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0698d9a5-52f7-4132-9162-188e0a8bd7fe tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:42.627149 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0697c24c-80f5-4aee-b0d2-891e785ccd1c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:42.627705 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0697c24c-80f5-4aee-b0d2-891e785ccd1c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:42.634053 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0697c24c-80f5-4aee-b0d2-891e785ccd1c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:42.634148 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0697c24c-80f5-4aee-b0d2-891e785ccd1c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:42.634974 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0697c24c-80f5-4aee-b0d2-891e785ccd1c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:42.635364 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0697c24c-80f5-4aee-b0d2-891e785ccd1c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:42.660783 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0697c24c-80f5-4aee-b0d2-891e785ccd1c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/ips" status: 200 len: 148 microversion: 2.1 time: 0.037969 Jun 16 00:30:42.666739 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 263/531] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 16 00:30:42 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:30:42.726408 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0698d9a5-52f7-4132-9162-188e0a8bd7fe tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:42.735022 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0698d9a5-52f7-4132-9162-188e0a8bd7fe tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:42.736566 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0698d9a5-52f7-4132-9162-188e0a8bd7fe tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:42.737720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0698d9a5-52f7-4132-9162-188e0a8bd7fe tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.158590 Jun 16 00:30:42.738264 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 269/532] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:42 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:43.233671 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bffab215-3cd8-4c71-b1e0-e3e78b18f49b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:43.234294 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bffab215-3cd8-4c71-b1e0-e3e78b18f49b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:43.240694 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bffab215-3cd8-4c71-b1e0-e3e78b18f49b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:43.241140 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bffab215-3cd8-4c71-b1e0-e3e78b18f49b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:43.241894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bffab215-3cd8-4c71-b1e0-e3e78b18f49b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:43.242326 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bffab215-3cd8-4c71-b1e0-e3e78b18f49b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:43.379216 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bffab215-3cd8-4c71-b1e0-e3e78b18f49b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:43.386603 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bffab215-3cd8-4c71-b1e0-e3e78b18f49b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.157376 Jun 16 00:30:43.387159 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 264/533] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:43 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:43.756033 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7849346c-f1d7-4753-a2ad-41fb2dfa448c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:43.756631 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7849346c-f1d7-4753-a2ad-41fb2dfa448c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:43.763446 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7849346c-f1d7-4753-a2ad-41fb2dfa448c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:43.763864 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7849346c-f1d7-4753-a2ad-41fb2dfa448c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:43.765194 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7849346c-f1d7-4753-a2ad-41fb2dfa448c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:43.765628 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7849346c-f1d7-4753-a2ad-41fb2dfa448c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:43.891536 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7849346c-f1d7-4753-a2ad-41fb2dfa448c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:43.899972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7849346c-f1d7-4753-a2ad-41fb2dfa448c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:43.901487 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7849346c-f1d7-4753-a2ad-41fb2dfa448c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:43.902650 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7849346c-f1d7-4753-a2ad-41fb2dfa448c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.150494 Jun 16 00:30:43.903196 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 270/534] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:43 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:44.005327 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-eca231fb-fb20-4f39-9390-5c26f8dbb81c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf64b0d3-0268-4c29-83ca-c92ae690805d"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:44.006441 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-eca231fb-fb20-4f39-9390-5c26f8dbb81c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:44.012439 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eca231fb-fb20-4f39-9390-5c26f8dbb81c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:44.012889 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eca231fb-fb20-4f39-9390-5c26f8dbb81c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:44.013649 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eca231fb-fb20-4f39-9390-5c26f8dbb81c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:44.014082 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eca231fb-fb20-4f39-9390-5c26f8dbb81c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:44.270568 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-eca231fb-fb20-4f39-9390-5c26f8dbb81c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269049 Jun 16 00:30:44.271200 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 265/535] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:30:44 2022] POST /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:44.457491 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-080b2f00-f804-4db3-a383-839a8dc45bf1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:44.458128 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-080b2f00-f804-4db3-a383-839a8dc45bf1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:44.464084 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-080b2f00-f804-4db3-a383-839a8dc45bf1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:44.464533 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-080b2f00-f804-4db3-a383-839a8dc45bf1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:44.465301 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-080b2f00-f804-4db3-a383-839a8dc45bf1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:44.465737 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-080b2f00-f804-4db3-a383-839a8dc45bf1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:44.595896 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-080b2f00-f804-4db3-a383-839a8dc45bf1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:44.603519 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-080b2f00-f804-4db3-a383-839a8dc45bf1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.149830 Jun 16 00:30:44.604103 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 271/536] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:44 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:44.923098 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1d4c75ef-0869-4033-9a5a-d1939e94ad1c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:44.923818 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1d4c75ef-0869-4033-9a5a-d1939e94ad1c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:44.930026 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1d4c75ef-0869-4033-9a5a-d1939e94ad1c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:44.930472 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1d4c75ef-0869-4033-9a5a-d1939e94ad1c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:44.931230 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1d4c75ef-0869-4033-9a5a-d1939e94ad1c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:44.931709 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1d4c75ef-0869-4033-9a5a-d1939e94ad1c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:45.060833 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1d4c75ef-0869-4033-9a5a-d1939e94ad1c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:45.069234 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1d4c75ef-0869-4033-9a5a-d1939e94ad1c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:45.070728 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1d4c75ef-0869-4033-9a5a-d1939e94ad1c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:45.071894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1d4c75ef-0869-4033-9a5a-d1939e94ad1c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.153989 Jun 16 00:30:45.072444 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 266/537] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:44 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:45.620217 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ab450842-d203-4f24-81ed-ead08a6e8d59 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:45.620855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ab450842-d203-4f24-81ed-ead08a6e8d59 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:45.627846 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ab450842-d203-4f24-81ed-ead08a6e8d59 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:45.628290 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ab450842-d203-4f24-81ed-ead08a6e8d59 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:45.629315 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ab450842-d203-4f24-81ed-ead08a6e8d59 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:45.629750 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ab450842-d203-4f24-81ed-ead08a6e8d59 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:45.758297 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ab450842-d203-4f24-81ed-ead08a6e8d59 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:45.766039 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ab450842-d203-4f24-81ed-ead08a6e8d59 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.150068 Jun 16 00:30:45.766585 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 272/538] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:45 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:46.089811 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c7551166-da28-48c3-ab6e-80ce1abb7f1e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:46.090408 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c7551166-da28-48c3-ab6e-80ce1abb7f1e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:46.097335 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c7551166-da28-48c3-ab6e-80ce1abb7f1e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:46.097772 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c7551166-da28-48c3-ab6e-80ce1abb7f1e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:46.098523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c7551166-da28-48c3-ab6e-80ce1abb7f1e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:46.098979 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c7551166-da28-48c3-ab6e-80ce1abb7f1e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:46.227336 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c7551166-da28-48c3-ab6e-80ce1abb7f1e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:46.235954 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c7551166-da28-48c3-ab6e-80ce1abb7f1e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:46.237484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c7551166-da28-48c3-ab6e-80ce1abb7f1e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:46.238625 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c7551166-da28-48c3-ab6e-80ce1abb7f1e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.152693 Jun 16 00:30:46.239185 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 267/539] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:46 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:46.782818 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a747a906-2123-402a-822f-ee6199ebe3ff tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:46.783573 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a747a906-2123-402a-822f-ee6199ebe3ff tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:46.790087 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a747a906-2123-402a-822f-ee6199ebe3ff tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:46.790531 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a747a906-2123-402a-822f-ee6199ebe3ff tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:46.791295 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a747a906-2123-402a-822f-ee6199ebe3ff tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:46.791754 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a747a906-2123-402a-822f-ee6199ebe3ff tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:46.918657 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a747a906-2123-402a-822f-ee6199ebe3ff tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:46.926573 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a747a906-2123-402a-822f-ee6199ebe3ff tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.147696 Jun 16 00:30:46.927127 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 273/540] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:46 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:47.256465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7355ecf0-5921-4700-bde3-ebb7c1853473 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:47.257124 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7355ecf0-5921-4700-bde3-ebb7c1853473 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:47.263554 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7355ecf0-5921-4700-bde3-ebb7c1853473 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:47.264040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7355ecf0-5921-4700-bde3-ebb7c1853473 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:47.265345 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7355ecf0-5921-4700-bde3-ebb7c1853473 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:47.265790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7355ecf0-5921-4700-bde3-ebb7c1853473 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:47.310749 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:47.393560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7355ecf0-5921-4700-bde3-ebb7c1853473 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:47.401442 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7355ecf0-5921-4700-bde3-ebb7c1853473 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:47.402935 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7355ecf0-5921-4700-bde3-ebb7c1853473 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:47.404150 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7355ecf0-5921-4700-bde3-ebb7c1853473 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.151569 Jun 16 00:30:47.404712 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 268/541] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:47 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:47.943349 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-890289b9-5a4a-4feb-9f95-3e28409646e6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:47.943991 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-890289b9-5a4a-4feb-9f95-3e28409646e6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:47.950371 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-890289b9-5a4a-4feb-9f95-3e28409646e6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:47.950812 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-890289b9-5a4a-4feb-9f95-3e28409646e6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:47.951569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-890289b9-5a4a-4feb-9f95-3e28409646e6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:47.952023 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-890289b9-5a4a-4feb-9f95-3e28409646e6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:48.080974 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-890289b9-5a4a-4feb-9f95-3e28409646e6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:48.088375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-890289b9-5a4a-4feb-9f95-3e28409646e6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.148940 Jun 16 00:30:48.088934 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 274/542] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:47 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:48.422944 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-840aee7d-9f1d-4821-ac12-c1414896b77b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:48.423567 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-840aee7d-9f1d-4821-ac12-c1414896b77b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:48.425408 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=8 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:48.431350 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-840aee7d-9f1d-4821-ac12-c1414896b77b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:48.431881 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-840aee7d-9f1d-4821-ac12-c1414896b77b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:48.432649 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-840aee7d-9f1d-4821-ac12-c1414896b77b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:48.433094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-840aee7d-9f1d-4821-ac12-c1414896b77b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:48.568434 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-840aee7d-9f1d-4821-ac12-c1414896b77b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:48.576513 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-840aee7d-9f1d-4821-ac12-c1414896b77b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:48.578072 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-840aee7d-9f1d-4821-ac12-c1414896b77b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:48.579238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-840aee7d-9f1d-4821-ac12-c1414896b77b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.160850 Jun 16 00:30:48.580175 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 269/543] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:48 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:49.104851 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8e4f537c-2ed0-4a4c-a9e9-85cb3fbeee6f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:49.105473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8e4f537c-2ed0-4a4c-a9e9-85cb3fbeee6f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:49.112471 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8e4f537c-2ed0-4a4c-a9e9-85cb3fbeee6f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:49.112914 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8e4f537c-2ed0-4a4c-a9e9-85cb3fbeee6f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:49.113668 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8e4f537c-2ed0-4a4c-a9e9-85cb3fbeee6f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:49.114097 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8e4f537c-2ed0-4a4c-a9e9-85cb3fbeee6f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:49.246410 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8e4f537c-2ed0-4a4c-a9e9-85cb3fbeee6f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:49.254268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8e4f537c-2ed0-4a4c-a9e9-85cb3fbeee6f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.153209 Jun 16 00:30:49.254824 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 275/544] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:49 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:49.596512 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3c0875d8-1805-4e0d-8d0a-27ad6da98758 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:49.597128 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3c0875d8-1805-4e0d-8d0a-27ad6da98758 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:49.603584 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c0875d8-1805-4e0d-8d0a-27ad6da98758 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:49.604068 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c0875d8-1805-4e0d-8d0a-27ad6da98758 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:49.604830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c0875d8-1805-4e0d-8d0a-27ad6da98758 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:49.605273 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c0875d8-1805-4e0d-8d0a-27ad6da98758 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:49.730886 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3c0875d8-1805-4e0d-8d0a-27ad6da98758 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:49.739307 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3c0875d8-1805-4e0d-8d0a-27ad6da98758 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:49.740838 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3c0875d8-1805-4e0d-8d0a-27ad6da98758 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:49.741999 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3c0875d8-1805-4e0d-8d0a-27ad6da98758 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.149435 Jun 16 00:30:49.742550 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 270/545] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:49 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:50.271468 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7dce0d81-2d14-4bb5-811c-cee229f4ac5e tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:50.272134 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7dce0d81-2d14-4bb5-811c-cee229f4ac5e tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:50.278737 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7dce0d81-2d14-4bb5-811c-cee229f4ac5e tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:50.279189 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7dce0d81-2d14-4bb5-811c-cee229f4ac5e tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:50.280048 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7dce0d81-2d14-4bb5-811c-cee229f4ac5e tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:50.280980 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7dce0d81-2d14-4bb5-811c-cee229f4ac5e tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:50.410556 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7dce0d81-2d14-4bb5-811c-cee229f4ac5e tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:50.417954 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7dce0d81-2d14-4bb5-811c-cee229f4ac5e tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.150620 Jun 16 00:30:50.418541 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 276/546] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:50 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:50.760515 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0b21beb9-4409-4040-95ad-46545cc11ece tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:50.761118 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0b21beb9-4409-4040-95ad-46545cc11ece tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:50.768431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0b21beb9-4409-4040-95ad-46545cc11ece tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:50.768902 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0b21beb9-4409-4040-95ad-46545cc11ece tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:50.769660 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0b21beb9-4409-4040-95ad-46545cc11ece tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:50.770089 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0b21beb9-4409-4040-95ad-46545cc11ece tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:50.905478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0b21beb9-4409-4040-95ad-46545cc11ece tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:50.913498 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0b21beb9-4409-4040-95ad-46545cc11ece tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:50.915005 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0b21beb9-4409-4040-95ad-46545cc11ece tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:50.916185 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0b21beb9-4409-4040-95ad-46545cc11ece tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.159763 Jun 16 00:30:50.916752 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 271/547] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:50 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:51.434305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-415378f8-7df0-4059-9945-f73ab547c35f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:51.434832 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-415378f8-7df0-4059-9945-f73ab547c35f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:51.441230 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-415378f8-7df0-4059-9945-f73ab547c35f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:51.441673 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-415378f8-7df0-4059-9945-f73ab547c35f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:51.442427 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-415378f8-7df0-4059-9945-f73ab547c35f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:51.442857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-415378f8-7df0-4059-9945-f73ab547c35f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:51.577682 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-415378f8-7df0-4059-9945-f73ab547c35f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:51.586107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-415378f8-7df0-4059-9945-f73ab547c35f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.155692 Jun 16 00:30:51.590257 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 277/548] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:51 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:51.769295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8fbe5b90-19cd-4718-8886-b554f968b172 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: .version_select at 0x7f958054a3a0>, body: {"keypair": {"name": "tempest-keypair-619866005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBML286VuPpsJCWCndN70uofDLEgPmg/3TABDj1YpMa1voXTvUmmyEPGyNey3wVPCdojxDHo8ArgzgjY7z8h7jC5e8STflNv63uKKva8G/oc6POtm/r9UqLJ6zjALPAl4Bw=="}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:51.784196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-8fbe5b90-19cd-4718-8886-b554f968b172 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for project def39ced63b64e3aa65c9542ae512e7e. Resources: {'key_pairs'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:30:51.787989 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-8fbe5b90-19cd-4718-8886-b554f968b172 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for user f0c5a5705f34440abce48190674a76d5 and project def39ced63b64e3aa65c9542ae512e7e. Resources: {'key_pairs'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:30:51.810111 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8fbe5b90-19cd-4718-8886-b554f968b172 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045365 Jun 16 00:30:51.810712 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 272/549] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 16 00:30:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:51.934436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a55f39ab-0fbb-4dde-bb7a-1546c9f77a15 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:51.935134 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a55f39ab-0fbb-4dde-bb7a-1546c9f77a15 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:51.941257 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a55f39ab-0fbb-4dde-bb7a-1546c9f77a15 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:51.941784 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a55f39ab-0fbb-4dde-bb7a-1546c9f77a15 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:51.942555 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a55f39ab-0fbb-4dde-bb7a-1546c9f77a15 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:51.943042 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a55f39ab-0fbb-4dde-bb7a-1546c9f77a15 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:51.961469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:52.078233 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a55f39ab-0fbb-4dde-bb7a-1546c9f77a15 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:52.086594 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a55f39ab-0fbb-4dde-bb7a-1546c9f77a15 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:52.088112 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a55f39ab-0fbb-4dde-bb7a-1546c9f77a15 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:52.089305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a55f39ab-0fbb-4dde-bb7a-1546c9f77a15 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1744 microversion: 2.20 time: 0.158941 Jun 16 00:30:52.089872 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 278/550] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:51 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:52.603483 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-006a5046-efea-48f3-a6e6-9d7beae530a5 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:52.604187 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-006a5046-efea-48f3-a6e6-9d7beae530a5 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:52.610676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-006a5046-efea-48f3-a6e6-9d7beae530a5 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:52.611135 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-006a5046-efea-48f3-a6e6-9d7beae530a5 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:52.612049 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-006a5046-efea-48f3-a6e6-9d7beae530a5 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:52.612493 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-006a5046-efea-48f3-a6e6-9d7beae530a5 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:52.801769 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-006a5046-efea-48f3-a6e6-9d7beae530a5 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:52.809250 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-006a5046-efea-48f3-a6e6-9d7beae530a5 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.209645 Jun 16 00:30:52.809818 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 273/551] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:52 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:53.109010 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-58a6cbe9-3809-4414-bbbc-7da47ed7dfcd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:53.109727 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-58a6cbe9-3809-4414-bbbc-7da47ed7dfcd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:53.116635 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-58a6cbe9-3809-4414-bbbc-7da47ed7dfcd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:53.117445 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-58a6cbe9-3809-4414-bbbc-7da47ed7dfcd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:53.118301 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-58a6cbe9-3809-4414-bbbc-7da47ed7dfcd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:53.118827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-58a6cbe9-3809-4414-bbbc-7da47ed7dfcd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:53.152126 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-683346050", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a813215-bb6e-4258-9089-1e234ad6c22c"}], "security_groups": [{"name": "tempest-securitygroup--1588114350"}], "key_name": "tempest-keypair-619866005", "user_data": "}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:53.294316 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-58a6cbe9-3809-4414-bbbc-7da47ed7dfcd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:53.296801 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] validate_networks() for [('0a813215-bb6e-4258-9089-1e234ad6c22c', None, None, None, None, None)] {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:30:53.304030 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-58a6cbe9-3809-4414-bbbc-7da47ed7dfcd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:53.306032 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-58a6cbe9-3809-4414-bbbc-7da47ed7dfcd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:53.307199 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-58a6cbe9-3809-4414-bbbc-7da47ed7dfcd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1744 microversion: 2.20 time: 0.203076 Jun 16 00:30:53.307777 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 279/552] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:53 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:53.323941 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-09a8c83a-b6b1-4715-ab0f-eccb65ee939e req-95f2562d-8300-4b35-80e9-12f584556a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb151dc-a559-4ad5-9a4f-c55e2609758f", "name": "network-vif-plugged", "status": "completed", "tag": "bf8752fe-370d-4c67-8d58-5ab0ba31fdc9"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:53.332715 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-09a8c83a-b6b1-4715-ab0f-eccb65ee939e req-95f2562d-8300-4b35-80e9-12f584556a52 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:53.333538 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-09a8c83a-b6b1-4715-ab0f-eccb65ee939e req-95f2562d-8300-4b35-80e9-12f584556a52 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:53.348993 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-09a8c83a-b6b1-4715-ab0f-eccb65ee939e req-95f2562d-8300-4b35-80e9-12f584556a52 service nova] Creating event network-vif-plugged:bf8752fe-370d-4c67-8d58-5ab0ba31fdc9 for instance ebb151dc-a559-4ad5-9a4f-c55e2609758f on hv-cinder-84327 Jun 16 00:30:53.354095 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-09a8c83a-b6b1-4715-ab0f-eccb65ee939e req-95f2562d-8300-4b35-80e9-12f584556a52 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033963 Jun 16 00:30:53.355173 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 280/553] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:30:53.687360 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:30:53.687816 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:30:53.688288 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:30:53.688712 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:30:53.689099 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:30:53.697850 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:53.698295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:53.699091 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:53.699523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:53.706862 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:53.719828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for project def39ced63b64e3aa65c9542ae512e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:30:53.723788 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for user f0c5a5705f34440abce48190674a76d5 and project def39ced63b64e3aa65c9542ae512e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:30:53.734648 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:30:53.737069 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:30:53.783797 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3420ee7d-5bc6-4ff5-a48d-56b189601069 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.636140 Jun 16 00:30:53.789299 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 274/554] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:30:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:30:53.794955 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-bd5ebee1-6521-4a2d-83c8-2fb69d946699 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:53.798376 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-bd5ebee1-6521-4a2d-83c8-2fb69d946699 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:53.828298 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-17f5a938-36b0-48b7-8cc4-b66700c00924 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:53.828965 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-17f5a938-36b0-48b7-8cc4-b66700c00924 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:53.837972 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-17f5a938-36b0-48b7-8cc4-b66700c00924 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:53.838435 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-17f5a938-36b0-48b7-8cc4-b66700c00924 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:53.839827 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-17f5a938-36b0-48b7-8cc4-b66700c00924 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:53.840206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-17f5a938-36b0-48b7-8cc4-b66700c00924 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:53.853223 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-bd5ebee1-6521-4a2d-83c8-2fb69d946699 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:53.861492 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-bd5ebee1-6521-4a2d-83c8-2fb69d946699 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1240 microversion: 2.1 time: 0.070648 Jun 16 00:30:53.867166 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 281/555] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:53 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:53.988468 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-17f5a938-36b0-48b7-8cc4-b66700c00924 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:54.001968 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-17f5a938-36b0-48b7-8cc4-b66700c00924 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.178912 Jun 16 00:30:54.002577 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 275/556] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:53 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:30:54.326073 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-35a0c419-8b42-41d9-8273-89886189feb9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:54.326666 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-35a0c419-8b42-41d9-8273-89886189feb9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:54.336527 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-35a0c419-8b42-41d9-8273-89886189feb9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:54.336970 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-35a0c419-8b42-41d9-8273-89886189feb9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:54.337737 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-35a0c419-8b42-41d9-8273-89886189feb9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:54.338168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-35a0c419-8b42-41d9-8273-89886189feb9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:54.464963 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-35a0c419-8b42-41d9-8273-89886189feb9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:54.473454 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-35a0c419-8b42-41d9-8273-89886189feb9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:54.474935 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-35a0c419-8b42-41d9-8273-89886189feb9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:54.476115 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-35a0c419-8b42-41d9-8273-89886189feb9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1744 microversion: 2.20 time: 0.153923 Jun 16 00:30:54.476658 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 282/557] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:54 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:54.878579 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-41c473ee-888e-4e80-b088-ad07662bba26 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:54.879223 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-41c473ee-888e-4e80-b088-ad07662bba26 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:54.885750 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-41c473ee-888e-4e80-b088-ad07662bba26 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:54.886199 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-41c473ee-888e-4e80-b088-ad07662bba26 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:54.886956 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-41c473ee-888e-4e80-b088-ad07662bba26 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:54.887392 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-41c473ee-888e-4e80-b088-ad07662bba26 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:54.947383 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-41c473ee-888e-4e80-b088-ad07662bba26 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:54.955279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-41c473ee-888e-4e80-b088-ad07662bba26 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1236 microversion: 2.1 time: 0.080585 Jun 16 00:30:54.955804 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 276/558] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:54 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:55.018709 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0e2cb62b-0174-4fa7-8d36-d6672f78f4fb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:55.019329 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0e2cb62b-0174-4fa7-8d36-d6672f78f4fb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:55.025581 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0e2cb62b-0174-4fa7-8d36-d6672f78f4fb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:55.026037 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0e2cb62b-0174-4fa7-8d36-d6672f78f4fb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:55.026828 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0e2cb62b-0174-4fa7-8d36-d6672f78f4fb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:55.027270 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0e2cb62b-0174-4fa7-8d36-d6672f78f4fb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:55.167554 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0e2cb62b-0174-4fa7-8d36-d6672f78f4fb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:55.177616 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0e2cb62b-0174-4fa7-8d36-d6672f78f4fb tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1258 microversion: 2.1 time: 0.163163 Jun 16 00:30:55.178576 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 283/559] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:55 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:55.372485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-a1e52f94-ded1-46b7-a923-455839d0fe17 req-9e7e89e2-fbab-4cca-9e6b-3a14c04f9600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b84afb6-466c-477a-9339-b4a0ecef36be", "name": "network-vif-plugged", "status": "completed", "tag": "f807a98a-f8e6-4868-ab21-4008a07a1ae4"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:55.381247 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-a1e52f94-ded1-46b7-a923-455839d0fe17 req-9e7e89e2-fbab-4cca-9e6b-3a14c04f9600 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:55.381688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-a1e52f94-ded1-46b7-a923-455839d0fe17 req-9e7e89e2-fbab-4cca-9e6b-3a14c04f9600 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:55.392198 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-a1e52f94-ded1-46b7-a923-455839d0fe17 req-9e7e89e2-fbab-4cca-9e6b-3a14c04f9600 service nova] Creating event network-vif-plugged:f807a98a-f8e6-4868-ab21-4008a07a1ae4 for instance 7b84afb6-466c-477a-9339-b4a0ecef36be on hv-cinder-84327 Jun 16 00:30:55.397443 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-a1e52f94-ded1-46b7-a923-455839d0fe17 req-9e7e89e2-fbab-4cca-9e6b-3a14c04f9600 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028605 Jun 16 00:30:55.398006 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 277/560] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:55.494177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b723dc6d-a790-49f6-af27-7d449a7f2eed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:55.494726 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b723dc6d-a790-49f6-af27-7d449a7f2eed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:55.501853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b723dc6d-a790-49f6-af27-7d449a7f2eed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:55.502307 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b723dc6d-a790-49f6-af27-7d449a7f2eed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:55.503075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b723dc6d-a790-49f6-af27-7d449a7f2eed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:55.503517 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b723dc6d-a790-49f6-af27-7d449a7f2eed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:55.629393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b723dc6d-a790-49f6-af27-7d449a7f2eed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:55.637496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b723dc6d-a790-49f6-af27-7d449a7f2eed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:55.638966 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b723dc6d-a790-49f6-af27-7d449a7f2eed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:55.640175 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b723dc6d-a790-49f6-af27-7d449a7f2eed tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1744 microversion: 2.20 time: 0.149946 Jun 16 00:30:55.640730 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 284/561] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:55 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:55.973733 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a810044c-0ce1-4672-919c-5648d9057e07 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:55.974424 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a810044c-0ce1-4672-919c-5648d9057e07 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:55.980594 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a810044c-0ce1-4672-919c-5648d9057e07 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:55.981040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a810044c-0ce1-4672-919c-5648d9057e07 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:55.981806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a810044c-0ce1-4672-919c-5648d9057e07 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:55.982241 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a810044c-0ce1-4672-919c-5648d9057e07 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:56.046274 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a810044c-0ce1-4672-919c-5648d9057e07 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:56.053754 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a810044c-0ce1-4672-919c-5648d9057e07 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1300 microversion: 2.1 time: 0.084669 Jun 16 00:30:56.054249 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 278/562] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:55 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:56.194056 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ce669c2a-417c-4078-b157-ebe35f12bf3a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:56.194663 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ce669c2a-417c-4078-b157-ebe35f12bf3a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:56.200713 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ce669c2a-417c-4078-b157-ebe35f12bf3a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:56.201166 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ce669c2a-417c-4078-b157-ebe35f12bf3a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:56.202441 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ce669c2a-417c-4078-b157-ebe35f12bf3a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:56.202873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ce669c2a-417c-4078-b157-ebe35f12bf3a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:56.331503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ce669c2a-417c-4078-b157-ebe35f12bf3a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:56.338863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ce669c2a-417c-4078-b157-ebe35f12bf3a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1441 microversion: 2.1 time: 0.148604 Jun 16 00:30:56.339424 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 285/563] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:56 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1441 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:56.355787 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2e82aead-9482-4364-a42c-92e701e98db6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:56.356392 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2e82aead-9482-4364-a42c-92e701e98db6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:56.362389 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2e82aead-9482-4364-a42c-92e701e98db6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:56.362836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2e82aead-9482-4364-a42c-92e701e98db6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:56.363716 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2e82aead-9482-4364-a42c-92e701e98db6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:56.364158 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2e82aead-9482-4364-a42c-92e701e98db6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:56.499339 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2e82aead-9482-4364-a42c-92e701e98db6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:56.507823 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2e82aead-9482-4364-a42c-92e701e98db6 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1441 microversion: 2.1 time: 0.155666 Jun 16 00:30:56.508773 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 279/564] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:56 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1441 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:56.658785 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9bdda089-240b-4ba7-81ba-036983af36bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:56.659426 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9bdda089-240b-4ba7-81ba-036983af36bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:56.666258 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9bdda089-240b-4ba7-81ba-036983af36bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:56.666741 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9bdda089-240b-4ba7-81ba-036983af36bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:56.667515 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9bdda089-240b-4ba7-81ba-036983af36bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:56.667979 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9bdda089-240b-4ba7-81ba-036983af36bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:56.883934 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9bdda089-240b-4ba7-81ba-036983af36bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:56.892260 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9bdda089-240b-4ba7-81ba-036983af36bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:56.894032 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9bdda089-240b-4ba7-81ba-036983af36bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:56.895198 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9bdda089-240b-4ba7-81ba-036983af36bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1744 microversion: 2.20 time: 0.240543 Jun 16 00:30:56.895777 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 286/565] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:56 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1744 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:57.070576 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-849494c6-c346-42bf-a1d6-6e9783b0bb42 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:57.071461 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-849494c6-c346-42bf-a1d6-6e9783b0bb42 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:57.078081 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-849494c6-c346-42bf-a1d6-6e9783b0bb42 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:57.078667 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-849494c6-c346-42bf-a1d6-6e9783b0bb42 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:57.079540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-849494c6-c346-42bf-a1d6-6e9783b0bb42 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:57.080281 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-849494c6-c346-42bf-a1d6-6e9783b0bb42 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:57.289356 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-849494c6-c346-42bf-a1d6-6e9783b0bb42 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:57.299812 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-849494c6-c346-42bf-a1d6-6e9783b0bb42 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1366 microversion: 2.1 time: 0.232859 Jun 16 00:30:57.301937 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 280/566] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:57 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:57.910405 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-65417093-1a54-4cb9-9de0-1c10f8dbecaf req-6f06fdfd-3db2-4ce8-bdb9-3fd3c9a24b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d275db-db63-4899-b5f6-ed3852580687", "tag": "c47ab338-4dce-4e11-84eb-63e0e2bccd8d"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:57.914304 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6461108c-9413-42e9-9e7d-6b7e780cef02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:57.915031 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6461108c-9413-42e9-9e7d-6b7e780cef02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:57.925308 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6461108c-9413-42e9-9e7d-6b7e780cef02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:57.928016 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6461108c-9413-42e9-9e7d-6b7e780cef02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:57.928903 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6461108c-9413-42e9-9e7d-6b7e780cef02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:57.929548 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6461108c-9413-42e9-9e7d-6b7e780cef02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:57.940127 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-65417093-1a54-4cb9-9de0-1c10f8dbecaf req-6f06fdfd-3db2-4ce8-bdb9-3fd3c9a24b1e service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:57.940766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-65417093-1a54-4cb9-9de0-1c10f8dbecaf req-6f06fdfd-3db2-4ce8-bdb9-3fd3c9a24b1e service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:57.961338 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-65417093-1a54-4cb9-9de0-1c10f8dbecaf req-6f06fdfd-3db2-4ce8-bdb9-3fd3c9a24b1e service nova] Creating event network-changed:c47ab338-4dce-4e11-84eb-63e0e2bccd8d for instance 15d275db-db63-4899-b5f6-ed3852580687 on hv-cinder-84327 Jun 16 00:30:57.967941 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-65417093-1a54-4cb9-9de0-1c10f8dbecaf req-6f06fdfd-3db2-4ce8-bdb9-3fd3c9a24b1e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062356 Jun 16 00:30:57.969386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 287/567] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:58.318994 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e06d2b6b-7e72-41f2-961b-78b258b6a722 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:58.319718 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e06d2b6b-7e72-41f2-961b-78b258b6a722 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:58.326132 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e06d2b6b-7e72-41f2-961b-78b258b6a722 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:58.326569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e06d2b6b-7e72-41f2-961b-78b258b6a722 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:58.327352 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e06d2b6b-7e72-41f2-961b-78b258b6a722 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:58.327817 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e06d2b6b-7e72-41f2-961b-78b258b6a722 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:58.461193 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6461108c-9413-42e9-9e7d-6b7e780cef02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:58.469568 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6461108c-9413-42e9-9e7d-6b7e780cef02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:58.471062 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6461108c-9413-42e9-9e7d-6b7e780cef02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:58.472548 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6461108c-9413-42e9-9e7d-6b7e780cef02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1744 microversion: 2.20 time: 0.563091 Jun 16 00:30:58.473118 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 281/568] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:57 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1744 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:30:58.578815 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e06d2b6b-7e72-41f2-961b-78b258b6a722 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:58.586285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e06d2b6b-7e72-41f2-961b-78b258b6a722 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1366 microversion: 2.1 time: 0.271475 Jun 16 00:30:58.587221 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 288/569] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:58 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:30:58.860523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-e51f1321-89c7-45a0-a185-ab1e03afc9f9 req-b66edce6-e1af-4533-ac5e-b85e2cdcd80c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb151dc-a559-4ad5-9a4f-c55e2609758f", "tag": "bf8752fe-370d-4c67-8d58-5ab0ba31fdc9"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:30:58.868418 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-e51f1321-89c7-45a0-a185-ab1e03afc9f9 req-b66edce6-e1af-4533-ac5e-b85e2cdcd80c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:58.868856 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-e51f1321-89c7-45a0-a185-ab1e03afc9f9 req-b66edce6-e1af-4533-ac5e-b85e2cdcd80c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:58.879636 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-e51f1321-89c7-45a0-a185-ab1e03afc9f9 req-b66edce6-e1af-4533-ac5e-b85e2cdcd80c service nova] Creating event network-changed:bf8752fe-370d-4c67-8d58-5ab0ba31fdc9 for instance ebb151dc-a559-4ad5-9a4f-c55e2609758f on hv-cinder-84327 Jun 16 00:30:58.884663 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-e51f1321-89c7-45a0-a185-ab1e03afc9f9 req-b66edce6-e1af-4533-ac5e-b85e2cdcd80c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028358 Jun 16 00:30:58.885422 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 282/570] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:30:59.490631 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-75d56ffe-078c-4f21-b59c-77b343e80f0e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:59.491263 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-75d56ffe-078c-4f21-b59c-77b343e80f0e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:59.498119 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-75d56ffe-078c-4f21-b59c-77b343e80f0e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:59.499305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-75d56ffe-078c-4f21-b59c-77b343e80f0e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:59.500113 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-75d56ffe-078c-4f21-b59c-77b343e80f0e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:59.500583 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-75d56ffe-078c-4f21-b59c-77b343e80f0e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:59.603581 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e3286450-c8a9-4da8-8e1b-8bfb9d3b9484 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:30:59.604319 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e3286450-c8a9-4da8-8e1b-8bfb9d3b9484 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:30:59.607988 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:59.612762 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e3286450-c8a9-4da8-8e1b-8bfb9d3b9484 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:59.613219 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e3286450-c8a9-4da8-8e1b-8bfb9d3b9484 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:59.613997 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e3286450-c8a9-4da8-8e1b-8bfb9d3b9484 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:30:59.614439 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e3286450-c8a9-4da8-8e1b-8bfb9d3b9484 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:30:59.636808 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-75d56ffe-078c-4f21-b59c-77b343e80f0e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:59.646065 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-75d56ffe-078c-4f21-b59c-77b343e80f0e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:59.647569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-75d56ffe-078c-4f21-b59c-77b343e80f0e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:59.648783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-75d56ffe-078c-4f21-b59c-77b343e80f0e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1744 microversion: 2.20 time: 0.162039 Jun 16 00:30:59.649330 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 289/571] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:30:59 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:30:59.759893 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e3286450-c8a9-4da8-8e1b-8bfb9d3b9484 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:30:59.768121 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e3286450-c8a9-4da8-8e1b-8bfb9d3b9484 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1366 microversion: 2.1 time: 0.168570 Jun 16 00:30:59.768690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 283/572] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:30:59 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:00.667449 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8b2c12a1-67e2-4736-9e96-38f819714c87 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:00.668089 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8b2c12a1-67e2-4736-9e96-38f819714c87 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:00.674539 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8b2c12a1-67e2-4736-9e96-38f819714c87 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:00.674972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8b2c12a1-67e2-4736-9e96-38f819714c87 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:00.675766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8b2c12a1-67e2-4736-9e96-38f819714c87 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:00.676197 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8b2c12a1-67e2-4736-9e96-38f819714c87 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:00.785257 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9586254b-598a-407e-ad3c-598320fc06cb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:00.785923 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9586254b-598a-407e-ad3c-598320fc06cb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:00.792557 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9586254b-598a-407e-ad3c-598320fc06cb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:00.793010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9586254b-598a-407e-ad3c-598320fc06cb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:00.794024 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9586254b-598a-407e-ad3c-598320fc06cb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:00.794300 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9586254b-598a-407e-ad3c-598320fc06cb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:00.805537 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8b2c12a1-67e2-4736-9e96-38f819714c87 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:00.813304 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8b2c12a1-67e2-4736-9e96-38f819714c87 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:00.814779 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8b2c12a1-67e2-4736-9e96-38f819714c87 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:00.815947 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8b2c12a1-67e2-4736-9e96-38f819714c87 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1744 microversion: 2.20 time: 0.152318 Jun 16 00:31:00.816491 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 290/573] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:00 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:00.919158 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9586254b-598a-407e-ad3c-598320fc06cb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:00.926530 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9586254b-598a-407e-ad3c-598320fc06cb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1366 microversion: 2.1 time: 0.145141 Jun 16 00:31:00.927085 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 284/574] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:00 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:01.834148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fde3bc9c-3839-4d96-b098-1b2346b00474 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:01.834752 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fde3bc9c-3839-4d96-b098-1b2346b00474 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:01.841439 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fde3bc9c-3839-4d96-b098-1b2346b00474 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:01.841884 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fde3bc9c-3839-4d96-b098-1b2346b00474 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:01.843179 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fde3bc9c-3839-4d96-b098-1b2346b00474 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:01.843669 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fde3bc9c-3839-4d96-b098-1b2346b00474 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:01.943389 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3120c4d1-a0be-410c-b180-c096ef552c67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:01.944026 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3120c4d1-a0be-410c-b180-c096ef552c67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:01.950913 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3120c4d1-a0be-410c-b180-c096ef552c67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:01.951369 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3120c4d1-a0be-410c-b180-c096ef552c67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:01.952198 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3120c4d1-a0be-410c-b180-c096ef552c67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:01.952637 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3120c4d1-a0be-410c-b180-c096ef552c67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:01.974581 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fde3bc9c-3839-4d96-b098-1b2346b00474 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:01.982761 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fde3bc9c-3839-4d96-b098-1b2346b00474 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:01.985016 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fde3bc9c-3839-4d96-b098-1b2346b00474 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:01.986211 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fde3bc9c-3839-4d96-b098-1b2346b00474 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1744 microversion: 2.20 time: 0.155941 Jun 16 00:31:01.986760 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 291/575] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:01 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:02.080584 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3120c4d1-a0be-410c-b180-c096ef552c67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:02.087882 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3120c4d1-a0be-410c-b180-c096ef552c67 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1366 microversion: 2.1 time: 0.148619 Jun 16 00:31:02.088441 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 285/576] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:01 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:03.004915 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d2b5cb12-ba7e-41b5-a01d-0b4a9499c7e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:03.005525 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d2b5cb12-ba7e-41b5-a01d-0b4a9499c7e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:03.014123 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d2b5cb12-ba7e-41b5-a01d-0b4a9499c7e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:03.014857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d2b5cb12-ba7e-41b5-a01d-0b4a9499c7e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:03.015659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d2b5cb12-ba7e-41b5-a01d-0b4a9499c7e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:03.016297 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d2b5cb12-ba7e-41b5-a01d-0b4a9499c7e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:03.106218 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c9907c70-06e4-4722-ae6c-3072ad858fbc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:03.106657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c9907c70-06e4-4722-ae6c-3072ad858fbc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:03.121986 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c9907c70-06e4-4722-ae6c-3072ad858fbc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:03.124479 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c9907c70-06e4-4722-ae6c-3072ad858fbc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:03.126140 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c9907c70-06e4-4722-ae6c-3072ad858fbc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:03.130993 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c9907c70-06e4-4722-ae6c-3072ad858fbc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:03.270245 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d2b5cb12-ba7e-41b5-a01d-0b4a9499c7e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:03.302935 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d2b5cb12-ba7e-41b5-a01d-0b4a9499c7e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:03.307668 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d2b5cb12-ba7e-41b5-a01d-0b4a9499c7e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:03.309434 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d2b5cb12-ba7e-41b5-a01d-0b4a9499c7e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1739 microversion: 2.20 time: 0.308378 Jun 16 00:31:03.310523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 292/577] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:02 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1739 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:03.366891 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c9907c70-06e4-4722-ae6c-3072ad858fbc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:03.375337 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c9907c70-06e4-4722-ae6c-3072ad858fbc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1366 microversion: 2.1 time: 0.273746 Jun 16 00:31:03.376418 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 286/578] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:03 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:04.331142 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e33aadb9-0d7e-49a5-a20d-0df77b2657b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:04.331760 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e33aadb9-0d7e-49a5-a20d-0df77b2657b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:04.334085 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:04.341665 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e33aadb9-0d7e-49a5-a20d-0df77b2657b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:04.342370 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e33aadb9-0d7e-49a5-a20d-0df77b2657b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:04.343320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e33aadb9-0d7e-49a5-a20d-0df77b2657b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:04.343798 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e33aadb9-0d7e-49a5-a20d-0df77b2657b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:04.393156 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-22a65c2b-29ff-453e-a0b4-2b45769ef9c7 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:04.394391 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-22a65c2b-29ff-453e-a0b4-2b45769ef9c7 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:04.402866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:04.403808 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=10 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:04.406292 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-22a65c2b-29ff-453e-a0b4-2b45769ef9c7 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:04.406910 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-22a65c2b-29ff-453e-a0b4-2b45769ef9c7 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:04.408103 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-22a65c2b-29ff-453e-a0b4-2b45769ef9c7 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:04.408708 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-22a65c2b-29ff-453e-a0b4-2b45769ef9c7 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:04.529067 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e33aadb9-0d7e-49a5-a20d-0df77b2657b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:04.538234 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e33aadb9-0d7e-49a5-a20d-0df77b2657b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:04.540312 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e33aadb9-0d7e-49a5-a20d-0df77b2657b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:04.541865 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e33aadb9-0d7e-49a5-a20d-0df77b2657b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1739 microversion: 2.20 time: 0.216097 Jun 16 00:31:04.554157 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 293/579] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:04 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:04.586248 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-22a65c2b-29ff-453e-a0b4-2b45769ef9c7 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:04.594211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-22a65c2b-29ff-453e-a0b4-2b45769ef9c7 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1366 microversion: 2.1 time: 0.205241 Jun 16 00:31:04.595686 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 287/580] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:04 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:05.353616 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-635580fa-da4c-4c09-9acf-e4ab43b748a1 req-c57c3dd8-b4f6-45ea-a38d-34f3b44e9b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d275db-db63-4899-b5f6-ed3852580687", "name": "network-vif-plugged", "status": "completed", "tag": "c47ab338-4dce-4e11-84eb-63e0e2bccd8d"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:05.364248 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=65 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:05.367565 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-635580fa-da4c-4c09-9acf-e4ab43b748a1 req-c57c3dd8-b4f6-45ea-a38d-34f3b44e9b3d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:05.368546 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-635580fa-da4c-4c09-9acf-e4ab43b748a1 req-c57c3dd8-b4f6-45ea-a38d-34f3b44e9b3d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:05.385782 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-635580fa-da4c-4c09-9acf-e4ab43b748a1 req-c57c3dd8-b4f6-45ea-a38d-34f3b44e9b3d service nova] Creating event network-vif-plugged:c47ab338-4dce-4e11-84eb-63e0e2bccd8d for instance 15d275db-db63-4899-b5f6-ed3852580687 on hv-cinder-84327 Jun 16 00:31:05.395215 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-635580fa-da4c-4c09-9acf-e4ab43b748a1 req-c57c3dd8-b4f6-45ea-a38d-34f3b44e9b3d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046651 Jun 16 00:31:05.396186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 294/581] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:05.561134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-dd3de799-ee91-4daf-83c6-fb33fa2e8783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:05.561743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-dd3de799-ee91-4daf-83c6-fb33fa2e8783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:05.569259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dd3de799-ee91-4daf-83c6-fb33fa2e8783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:05.569726 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dd3de799-ee91-4daf-83c6-fb33fa2e8783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:05.570502 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dd3de799-ee91-4daf-83c6-fb33fa2e8783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:05.571191 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dd3de799-ee91-4daf-83c6-fb33fa2e8783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:05.611834 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5c9cd3ff-e736-4a6f-964d-de905403c518 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:05.613099 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5c9cd3ff-e736-4a6f-964d-de905403c518 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:05.623545 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5c9cd3ff-e736-4a6f-964d-de905403c518 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:05.624075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5c9cd3ff-e736-4a6f-964d-de905403c518 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:05.624923 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5c9cd3ff-e736-4a6f-964d-de905403c518 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:05.625364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5c9cd3ff-e736-4a6f-964d-de905403c518 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:05.826182 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-dd3de799-ee91-4daf-83c6-fb33fa2e8783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:05.841327 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-dd3de799-ee91-4daf-83c6-fb33fa2e8783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:05.843389 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-dd3de799-ee91-4daf-83c6-fb33fa2e8783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:05.844571 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-dd3de799-ee91-4daf-83c6-fb33fa2e8783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1739 microversion: 2.20 time: 0.287559 Jun 16 00:31:05.845128 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 288/582] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:05 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:05.855878 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5c9cd3ff-e736-4a6f-964d-de905403c518 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:05.863283 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5c9cd3ff-e736-4a6f-964d-de905403c518 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1366 microversion: 2.1 time: 0.256398 Jun 16 00:31:05.863869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 295/583] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:05 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:06.864182 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0a0f7669-b583-428e-a95d-422bc5daee58 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:06.865490 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0a0f7669-b583-428e-a95d-422bc5daee58 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:06.875249 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a0f7669-b583-428e-a95d-422bc5daee58 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:06.875934 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a0f7669-b583-428e-a95d-422bc5daee58 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:06.876926 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a0f7669-b583-428e-a95d-422bc5daee58 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:06.877591 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a0f7669-b583-428e-a95d-422bc5daee58 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:06.880670 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a96fdff5-3374-482d-89aa-f0aae982d577 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:06.881894 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a96fdff5-3374-482d-89aa-f0aae982d577 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:06.889622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a96fdff5-3374-482d-89aa-f0aae982d577 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:06.890030 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a96fdff5-3374-482d-89aa-f0aae982d577 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:06.890982 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a96fdff5-3374-482d-89aa-f0aae982d577 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:06.891428 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a96fdff5-3374-482d-89aa-f0aae982d577 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:07.093580 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a96fdff5-3374-482d-89aa-f0aae982d577 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:07.101291 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a96fdff5-3374-482d-89aa-f0aae982d577 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1366 microversion: 2.1 time: 0.224875 Jun 16 00:31:07.102192 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 296/584] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:06 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:07.110204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0a0f7669-b583-428e-a95d-422bc5daee58 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:07.118370 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0a0f7669-b583-428e-a95d-422bc5daee58 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:07.119890 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0a0f7669-b583-428e-a95d-422bc5daee58 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:07.121043 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0a0f7669-b583-428e-a95d-422bc5daee58 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1739 microversion: 2.20 time: 0.261200 Jun 16 00:31:07.121600 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 289/585] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:06 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:08.118109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e142286c-221c-4a0e-957e-14b12d33a86e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:08.118908 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e142286c-221c-4a0e-957e-14b12d33a86e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:08.125190 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e142286c-221c-4a0e-957e-14b12d33a86e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.125843 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e142286c-221c-4a0e-957e-14b12d33a86e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.126640 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e142286c-221c-4a0e-957e-14b12d33a86e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.127046 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e142286c-221c-4a0e-957e-14b12d33a86e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.140290 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1483f152-dee9-4afa-ac63-d95a74129f1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:08.141619 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1483f152-dee9-4afa-ac63-d95a74129f1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:08.148633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1483f152-dee9-4afa-ac63-d95a74129f1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.149284 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1483f152-dee9-4afa-ac63-d95a74129f1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.150226 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1483f152-dee9-4afa-ac63-d95a74129f1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.150924 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1483f152-dee9-4afa-ac63-d95a74129f1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.545535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e142286c-221c-4a0e-957e-14b12d33a86e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:08.549123 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1483f152-dee9-4afa-ac63-d95a74129f1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:08.559592 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e142286c-221c-4a0e-957e-14b12d33a86e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1556 microversion: 2.1 time: 0.445127 Jun 16 00:31:08.559976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1483f152-dee9-4afa-ac63-d95a74129f1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:08.563032 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 297/586] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:08 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1556 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:08.566704 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1483f152-dee9-4afa-ac63-d95a74129f1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:08.567938 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1483f152-dee9-4afa-ac63-d95a74129f1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1739 microversion: 2.20 time: 0.432724 Jun 16 00:31:08.572338 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 290/587] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:08 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1739 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:08.581951 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-76d0988f-66b2-4b53-becc-92575d1450c4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:08.582947 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-76d0988f-66b2-4b53-becc-92575d1450c4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:08.592452 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-76d0988f-66b2-4b53-becc-92575d1450c4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.593182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-76d0988f-66b2-4b53-becc-92575d1450c4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.593997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-76d0988f-66b2-4b53-becc-92575d1450c4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:08.594431 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-76d0988f-66b2-4b53-becc-92575d1450c4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:08.598749 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=100 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:08.690989 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-76d0988f-66b2-4b53-becc-92575d1450c4 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115825 Jun 16 00:31:08.691750 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 298/588] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 16 00:31:08 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:09.603464 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b1d489cb-7064-405b-884e-e9128578ca56 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:09.604124 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b1d489cb-7064-405b-884e-e9128578ca56 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:09.613167 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b1d489cb-7064-405b-884e-e9128578ca56 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:09.614079 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b1d489cb-7064-405b-884e-e9128578ca56 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:09.616762 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b1d489cb-7064-405b-884e-e9128578ca56 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:09.617552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b1d489cb-7064-405b-884e-e9128578ca56 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:09.931043 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b1d489cb-7064-405b-884e-e9128578ca56 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:09.940816 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b1d489cb-7064-405b-884e-e9128578ca56 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:09.942497 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b1d489cb-7064-405b-884e-e9128578ca56 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:09.943689 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b1d489cb-7064-405b-884e-e9128578ca56 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1739 microversion: 2.20 time: 0.355276 Jun 16 00:31:09.955248 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 291/589] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:09 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1739 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:10.142539 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-c4ddc7d4-7a26-458d-84d5-fc911f3322ea req-068e8964-7cac-45f6-8c47-0fc58e2dda4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d275db-db63-4899-b5f6-ed3852580687", "tag": "c47ab338-4dce-4e11-84eb-63e0e2bccd8d"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:10.153229 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-c4ddc7d4-7a26-458d-84d5-fc911f3322ea req-068e8964-7cac-45f6-8c47-0fc58e2dda4a service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:10.153870 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-c4ddc7d4-7a26-458d-84d5-fc911f3322ea req-068e8964-7cac-45f6-8c47-0fc58e2dda4a service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:10.167082 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-c4ddc7d4-7a26-458d-84d5-fc911f3322ea req-068e8964-7cac-45f6-8c47-0fc58e2dda4a service nova] Creating event network-changed:c47ab338-4dce-4e11-84eb-63e0e2bccd8d for instance 15d275db-db63-4899-b5f6-ed3852580687 on hv-cinder-84327 Jun 16 00:31:10.173020 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-c4ddc7d4-7a26-458d-84d5-fc911f3322ea req-068e8964-7cac-45f6-8c47-0fc58e2dda4a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035248 Jun 16 00:31:10.177289 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 299/590] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:31:10.963009 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-10579f9e-e3cf-477f-98c1-8cf584290d7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:10.964461 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-10579f9e-e3cf-477f-98c1-8cf584290d7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:10.971794 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-10579f9e-e3cf-477f-98c1-8cf584290d7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:10.972239 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-10579f9e-e3cf-477f-98c1-8cf584290d7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:10.973209 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-10579f9e-e3cf-477f-98c1-8cf584290d7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:10.973801 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-10579f9e-e3cf-477f-98c1-8cf584290d7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:11.165522 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-10579f9e-e3cf-477f-98c1-8cf584290d7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:11.169522 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=100 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:11.183558 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-10579f9e-e3cf-477f-98c1-8cf584290d7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:11.187875 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-10579f9e-e3cf-477f-98c1-8cf584290d7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:11.189494 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-10579f9e-e3cf-477f-98c1-8cf584290d7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1739 microversion: 2.20 time: 0.230590 Jun 16 00:31:11.200047 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 292/591] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:10 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:12.209398 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e82d0f0e-c828-42db-941c-4343925a579f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:12.212377 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e82d0f0e-c828-42db-941c-4343925a579f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:12.221285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e82d0f0e-c828-42db-941c-4343925a579f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:12.221727 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e82d0f0e-c828-42db-941c-4343925a579f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:12.222491 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e82d0f0e-c828-42db-941c-4343925a579f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:12.222922 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e82d0f0e-c828-42db-941c-4343925a579f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:12.361023 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e82d0f0e-c828-42db-941c-4343925a579f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:12.369861 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e82d0f0e-c828-42db-941c-4343925a579f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:12.371567 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e82d0f0e-c828-42db-941c-4343925a579f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:12.373017 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e82d0f0e-c828-42db-941c-4343925a579f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1739 microversion: 2.20 time: 0.167992 Jun 16 00:31:12.384417 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 300/592] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:12 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:13.393532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-fdf3f301-644d-47b5-9bb4-4a8083d609fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:13.394155 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-fdf3f301-644d-47b5-9bb4-4a8083d609fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:13.401662 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fdf3f301-644d-47b5-9bb4-4a8083d609fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:13.402108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fdf3f301-644d-47b5-9bb4-4a8083d609fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:13.402855 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fdf3f301-644d-47b5-9bb4-4a8083d609fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:13.403290 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fdf3f301-644d-47b5-9bb4-4a8083d609fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:13.530785 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fdf3f301-644d-47b5-9bb4-4a8083d609fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:13.538605 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fdf3f301-644d-47b5-9bb4-4a8083d609fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:13.540132 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fdf3f301-644d-47b5-9bb4-4a8083d609fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:13.541295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-fdf3f301-644d-47b5-9bb4-4a8083d609fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1721 microversion: 2.20 time: 0.153119 Jun 16 00:31:13.541852 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 293/593] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:13 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:14.559594 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-aee20f4d-42fb-471b-ba04-d30dab6e416d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:14.560226 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-aee20f4d-42fb-471b-ba04-d30dab6e416d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:14.567341 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aee20f4d-42fb-471b-ba04-d30dab6e416d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:14.567838 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aee20f4d-42fb-471b-ba04-d30dab6e416d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:14.568606 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aee20f4d-42fb-471b-ba04-d30dab6e416d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:14.569042 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aee20f4d-42fb-471b-ba04-d30dab6e416d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:14.698925 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-aee20f4d-42fb-471b-ba04-d30dab6e416d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:14.707447 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-aee20f4d-42fb-471b-ba04-d30dab6e416d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:14.708978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-aee20f4d-42fb-471b-ba04-d30dab6e416d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:14.710168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-aee20f4d-42fb-471b-ba04-d30dab6e416d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1721 microversion: 2.20 time: 0.154485 Jun 16 00:31:14.710724 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 301/594] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:14 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:15.727837 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-34c3366b-3670-42f9-98e2-60b0f5ba7c6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:15.728441 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-34c3366b-3670-42f9-98e2-60b0f5ba7c6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:15.734959 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-34c3366b-3670-42f9-98e2-60b0f5ba7c6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:15.735399 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-34c3366b-3670-42f9-98e2-60b0f5ba7c6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:15.736188 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-34c3366b-3670-42f9-98e2-60b0f5ba7c6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:15.736617 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-34c3366b-3670-42f9-98e2-60b0f5ba7c6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:15.862559 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-34c3366b-3670-42f9-98e2-60b0f5ba7c6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:15.870312 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-34c3366b-3670-42f9-98e2-60b0f5ba7c6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:15.871830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-34c3366b-3670-42f9-98e2-60b0f5ba7c6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:15.872962 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-34c3366b-3670-42f9-98e2-60b0f5ba7c6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1721 microversion: 2.20 time: 0.149054 Jun 16 00:31:15.873503 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 294/595] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:15 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:16.890272 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5b7c694b-cbea-4102-8fd2-2b83a23810fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:16.890872 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5b7c694b-cbea-4102-8fd2-2b83a23810fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:16.897575 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5b7c694b-cbea-4102-8fd2-2b83a23810fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:16.898017 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5b7c694b-cbea-4102-8fd2-2b83a23810fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:16.898773 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5b7c694b-cbea-4102-8fd2-2b83a23810fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:16.899204 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5b7c694b-cbea-4102-8fd2-2b83a23810fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:17.028329 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5b7c694b-cbea-4102-8fd2-2b83a23810fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:17.036730 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5b7c694b-cbea-4102-8fd2-2b83a23810fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:17.038225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5b7c694b-cbea-4102-8fd2-2b83a23810fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:17.039370 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5b7c694b-cbea-4102-8fd2-2b83a23810fb tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1664 microversion: 2.20 time: 0.153053 Jun 16 00:31:17.039949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 302/596] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:16 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:17.057082 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-95a3a546-3894-47a3-8e19-3385a3cc69ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c12fb86f-e13e-4edc-9d3e-811f4af1c55b"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:17.058071 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-95a3a546-3894-47a3-8e19-3385a3cc69ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:17.064726 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-95a3a546-3894-47a3-8e19-3385a3cc69ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:17.065181 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-95a3a546-3894-47a3-8e19-3385a3cc69ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:17.065944 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-95a3a546-3894-47a3-8e19-3385a3cc69ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:17.066379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-95a3a546-3894-47a3-8e19-3385a3cc69ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:17.330040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-99d08ea7-58b1-48fb-b4dd-86b1afa28a7d req-1e6abc33-d79f-424f-bb0b-c3d180341826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b84afb6-466c-477a-9339-b4a0ecef36be", "name": "network-vif-unplugged", "status": "completed", "tag": "f807a98a-f8e6-4868-ab21-4008a07a1ae4"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:17.338253 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-99d08ea7-58b1-48fb-b4dd-86b1afa28a7d req-1e6abc33-d79f-424f-bb0b-c3d180341826 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:17.338700 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-99d08ea7-58b1-48fb-b4dd-86b1afa28a7d req-1e6abc33-d79f-424f-bb0b-c3d180341826 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:17.339545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-95a3a546-3894-47a3-8e19-3385a3cc69ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "POST /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286386 Jun 16 00:31:17.345555 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 295/597] 10.222.0.44 () {62 vars in 1363 bytes} [Thu Jun 16 00:31:17 2022] POST /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:31:17.350965 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.compute.server_external_events [req-99d08ea7-58b1-48fb-b4dd-86b1afa28a7d req-1e6abc33-d79f-424f-bb0b-c3d180341826 service nova] Unable to find a host for instance 7b84afb6-466c-477a-9339-b4a0ecef36be. Dropping event network-vif-unplugged {{(pid=129466) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 00:31:17.351955 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-99d08ea7-58b1-48fb-b4dd-86b1afa28a7d req-1e6abc33-d79f-424f-bb0b-c3d180341826 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026381 Jun 16 00:31:17.352784 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 303/598] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 00:31:17.454493 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e5dd6a02-4e18-4e0d-bd2f-40a2a068c18b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:17.455103 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e5dd6a02-4e18-4e0d-bd2f-40a2a068c18b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:17.461776 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e5dd6a02-4e18-4e0d-bd2f-40a2a068c18b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:17.462225 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e5dd6a02-4e18-4e0d-bd2f-40a2a068c18b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:17.462990 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e5dd6a02-4e18-4e0d-bd2f-40a2a068c18b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:17.463453 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e5dd6a02-4e18-4e0d-bd2f-40a2a068c18b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:17.551715 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e5dd6a02-4e18-4e0d-bd2f-40a2a068c18b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "POST /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/action" status: 202 len: 0 microversion: 2.20 time: 0.101737 Jun 16 00:31:17.552439 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 296/599] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jun 16 00:31:17 2022] POST /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:31:17.560638 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-01142740-82a9-4007-be42-9c5af79f2646 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:17.561877 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-01142740-82a9-4007-be42-9c5af79f2646 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:17.568097 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-01142740-82a9-4007-be42-9c5af79f2646 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:17.568489 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-01142740-82a9-4007-be42-9c5af79f2646 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:17.569255 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-01142740-82a9-4007-be42-9c5af79f2646 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:17.569692 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-01142740-82a9-4007-be42-9c5af79f2646 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:17.700843 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-01142740-82a9-4007-be42-9c5af79f2646 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:17.710530 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-01142740-82a9-4007-be42-9c5af79f2646 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:17.712060 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-01142740-82a9-4007-be42-9c5af79f2646 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:17.713225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-01142740-82a9-4007-be42-9c5af79f2646 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1750 microversion: 2.20 time: 0.156510 Jun 16 00:31:17.713822 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 304/600] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:17 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:18.732056 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b4b12bdb-b8bd-4ce1-959f-24826abe46d8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:18.732808 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b4b12bdb-b8bd-4ce1-959f-24826abe46d8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:18.741207 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b4b12bdb-b8bd-4ce1-959f-24826abe46d8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:18.741661 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b4b12bdb-b8bd-4ce1-959f-24826abe46d8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:18.742422 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b4b12bdb-b8bd-4ce1-959f-24826abe46d8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:18.742857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b4b12bdb-b8bd-4ce1-959f-24826abe46d8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:18.872631 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b4b12bdb-b8bd-4ce1-959f-24826abe46d8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:18.880835 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b4b12bdb-b8bd-4ce1-959f-24826abe46d8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:18.882312 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b4b12bdb-b8bd-4ce1-959f-24826abe46d8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:18.883451 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b4b12bdb-b8bd-4ce1-959f-24826abe46d8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1752 microversion: 2.20 time: 0.155730 Jun 16 00:31:18.884049 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 297/601] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:18 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:19.902937 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a4d8885a-c196-4caa-8a3a-90f2b0244a0b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:19.903539 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a4d8885a-c196-4caa-8a3a-90f2b0244a0b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:19.910555 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a4d8885a-c196-4caa-8a3a-90f2b0244a0b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:19.911000 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a4d8885a-c196-4caa-8a3a-90f2b0244a0b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:19.911803 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a4d8885a-c196-4caa-8a3a-90f2b0244a0b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:19.912234 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a4d8885a-c196-4caa-8a3a-90f2b0244a0b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:20.040074 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a4d8885a-c196-4caa-8a3a-90f2b0244a0b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:20.048415 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a4d8885a-c196-4caa-8a3a-90f2b0244a0b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:20.049918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a4d8885a-c196-4caa-8a3a-90f2b0244a0b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:20.051082 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a4d8885a-c196-4caa-8a3a-90f2b0244a0b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.152040 Jun 16 00:31:20.051658 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 305/602] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:19 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:21.069365 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-59cd2e79-2e6e-4c97-8387-f267b4bdf4ff tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:21.069919 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-59cd2e79-2e6e-4c97-8387-f267b4bdf4ff tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:21.075965 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-59cd2e79-2e6e-4c97-8387-f267b4bdf4ff tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:21.076413 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-59cd2e79-2e6e-4c97-8387-f267b4bdf4ff tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:21.077674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-59cd2e79-2e6e-4c97-8387-f267b4bdf4ff tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:21.078099 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-59cd2e79-2e6e-4c97-8387-f267b4bdf4ff tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:21.209395 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-59cd2e79-2e6e-4c97-8387-f267b4bdf4ff tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:21.218254 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-59cd2e79-2e6e-4c97-8387-f267b4bdf4ff tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:21.219845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-59cd2e79-2e6e-4c97-8387-f267b4bdf4ff tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:21.221081 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-59cd2e79-2e6e-4c97-8387-f267b4bdf4ff tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.155566 Jun 16 00:31:21.221838 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 298/603] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:21 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:22.240464 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8c049ddd-4f63-4df5-8366-0be5bfb87dd2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:22.241078 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8c049ddd-4f63-4df5-8366-0be5bfb87dd2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:22.247596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c049ddd-4f63-4df5-8366-0be5bfb87dd2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:22.248077 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c049ddd-4f63-4df5-8366-0be5bfb87dd2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:22.248859 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c049ddd-4f63-4df5-8366-0be5bfb87dd2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:22.249298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c049ddd-4f63-4df5-8366-0be5bfb87dd2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:22.382611 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8c049ddd-4f63-4df5-8366-0be5bfb87dd2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:22.391377 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8c049ddd-4f63-4df5-8366-0be5bfb87dd2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:22.392894 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8c049ddd-4f63-4df5-8366-0be5bfb87dd2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:22.394303 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8c049ddd-4f63-4df5-8366-0be5bfb87dd2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.157782 Jun 16 00:31:22.394947 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 306/604] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:22 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:22.450273 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0bfe9ed5-82f1-4791-904e-430c449ee729 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a36d455-6fe9-4d74-aec4-c833744606ea"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:22.451391 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0bfe9ed5-82f1-4791-904e-430c449ee729 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:22.457837 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0bfe9ed5-82f1-4791-904e-430c449ee729 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:22.458283 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0bfe9ed5-82f1-4791-904e-430c449ee729 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:22.459043 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0bfe9ed5-82f1-4791-904e-430c449ee729 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:22.459501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0bfe9ed5-82f1-4791-904e-430c449ee729 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:22.758720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:31:22.758939 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Thu Jun 16 00:31:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:31:23.520391 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-83e747f8-c4f7-444f-984e-7ba781d00167 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:23.520995 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-83e747f8-c4f7-444f-984e-7ba781d00167 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:23.526888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-83e747f8-c4f7-444f-984e-7ba781d00167 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:23.527328 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-83e747f8-c4f7-444f-984e-7ba781d00167 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:23.528115 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-83e747f8-c4f7-444f-984e-7ba781d00167 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:23.528545 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-83e747f8-c4f7-444f-984e-7ba781d00167 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:23.667688 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-83e747f8-c4f7-444f-984e-7ba781d00167 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:23.676919 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-83e747f8-c4f7-444f-984e-7ba781d00167 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:23.678407 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-83e747f8-c4f7-444f-984e-7ba781d00167 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:23.679564 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-83e747f8-c4f7-444f-984e-7ba781d00167 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.270220 Jun 16 00:31:23.680136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 307/605] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:23 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:24.697704 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-270c74bf-221c-4d06-a1eb-a8eac47df934 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:24.698452 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-270c74bf-221c-4d06-a1eb-a8eac47df934 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:24.704844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-270c74bf-221c-4d06-a1eb-a8eac47df934 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:24.705299 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-270c74bf-221c-4d06-a1eb-a8eac47df934 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:24.706069 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-270c74bf-221c-4d06-a1eb-a8eac47df934 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:24.706509 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-270c74bf-221c-4d06-a1eb-a8eac47df934 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:24.846930 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-270c74bf-221c-4d06-a1eb-a8eac47df934 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:24.855276 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-270c74bf-221c-4d06-a1eb-a8eac47df934 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:24.856799 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-270c74bf-221c-4d06-a1eb-a8eac47df934 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:24.858493 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-270c74bf-221c-4d06-a1eb-a8eac47df934 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.164178 Jun 16 00:31:24.859038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 308/606] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:24 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:25.877278 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-93c7001b-d39d-4b6d-98ca-8e2ba179d8ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:25.877939 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-93c7001b-d39d-4b6d-98ca-8e2ba179d8ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:25.884566 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-93c7001b-d39d-4b6d-98ca-8e2ba179d8ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:25.885015 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-93c7001b-d39d-4b6d-98ca-8e2ba179d8ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:25.885778 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-93c7001b-d39d-4b6d-98ca-8e2ba179d8ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:25.886233 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-93c7001b-d39d-4b6d-98ca-8e2ba179d8ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:26.019494 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-93c7001b-d39d-4b6d-98ca-8e2ba179d8ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:26.028150 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-93c7001b-d39d-4b6d-98ca-8e2ba179d8ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:26.029648 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-93c7001b-d39d-4b6d-98ca-8e2ba179d8ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:26.030810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-93c7001b-d39d-4b6d-98ca-8e2ba179d8ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.158014 Jun 16 00:31:26.031360 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 309/607] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:25 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:27.050121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-07428069-c62d-4175-a96f-4365b17e0676 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:27.051437 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-07428069-c62d-4175-a96f-4365b17e0676 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:27.059999 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-07428069-c62d-4175-a96f-4365b17e0676 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:27.060743 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-07428069-c62d-4175-a96f-4365b17e0676 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:27.062182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-07428069-c62d-4175-a96f-4365b17e0676 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:27.062834 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-07428069-c62d-4175-a96f-4365b17e0676 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:27.194552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-07428069-c62d-4175-a96f-4365b17e0676 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:27.203978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-07428069-c62d-4175-a96f-4365b17e0676 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:27.205476 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-07428069-c62d-4175-a96f-4365b17e0676 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:27.206657 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-07428069-c62d-4175-a96f-4365b17e0676 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.161320 Jun 16 00:31:27.207387 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 310/608] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:27 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:28.224332 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-827bc72b-78b0-47e8-af0f-1a792f6f3d28 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:28.225022 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-827bc72b-78b0-47e8-af0f-1a792f6f3d28 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:28.231472 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-827bc72b-78b0-47e8-af0f-1a792f6f3d28 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:28.231959 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-827bc72b-78b0-47e8-af0f-1a792f6f3d28 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:28.232729 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-827bc72b-78b0-47e8-af0f-1a792f6f3d28 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:28.233167 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-827bc72b-78b0-47e8-af0f-1a792f6f3d28 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:28.370065 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-827bc72b-78b0-47e8-af0f-1a792f6f3d28 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:28.379018 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-827bc72b-78b0-47e8-af0f-1a792f6f3d28 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:28.380559 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-827bc72b-78b0-47e8-af0f-1a792f6f3d28 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:28.381712 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-827bc72b-78b0-47e8-af0f-1a792f6f3d28 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.161275 Jun 16 00:31:28.382274 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 311/609] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:28 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:29.400600 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-29d35bfb-106b-4f88-8c50-e4ec013626fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:29.401283 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-29d35bfb-106b-4f88-8c50-e4ec013626fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:29.408114 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-29d35bfb-106b-4f88-8c50-e4ec013626fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:29.408561 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-29d35bfb-106b-4f88-8c50-e4ec013626fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:29.409394 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-29d35bfb-106b-4f88-8c50-e4ec013626fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:29.409812 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-29d35bfb-106b-4f88-8c50-e4ec013626fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:29.545654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-29d35bfb-106b-4f88-8c50-e4ec013626fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:29.555755 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-29d35bfb-106b-4f88-8c50-e4ec013626fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:29.557299 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-29d35bfb-106b-4f88-8c50-e4ec013626fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:29.558473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-29d35bfb-106b-4f88-8c50-e4ec013626fd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.161992 Jun 16 00:31:29.559011 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 312/610] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:29 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:30.578552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-431f6ba8-0b1c-42df-9d4d-9baa5bd2ed2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:30.580509 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-431f6ba8-0b1c-42df-9d4d-9baa5bd2ed2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:30.589724 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-431f6ba8-0b1c-42df-9d4d-9baa5bd2ed2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:30.590232 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-431f6ba8-0b1c-42df-9d4d-9baa5bd2ed2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:30.591249 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-431f6ba8-0b1c-42df-9d4d-9baa5bd2ed2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:30.591693 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-431f6ba8-0b1c-42df-9d4d-9baa5bd2ed2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:30.722322 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-431f6ba8-0b1c-42df-9d4d-9baa5bd2ed2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:30.734280 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-431f6ba8-0b1c-42df-9d4d-9baa5bd2ed2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:30.736727 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-431f6ba8-0b1c-42df-9d4d-9baa5bd2ed2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:30.737927 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-431f6ba8-0b1c-42df-9d4d-9baa5bd2ed2a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.164205 Jun 16 00:31:30.738480 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 313/611] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:30 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:31.756334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1e3981a2-5a94-41d3-ab4b-d495927cb086 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:31.757023 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1e3981a2-5a94-41d3-ab4b-d495927cb086 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:31.763533 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1e3981a2-5a94-41d3-ab4b-d495927cb086 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:31.764051 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1e3981a2-5a94-41d3-ab4b-d495927cb086 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:31.764848 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1e3981a2-5a94-41d3-ab4b-d495927cb086 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:31.765281 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1e3981a2-5a94-41d3-ab4b-d495927cb086 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:31.904227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1e3981a2-5a94-41d3-ab4b-d495927cb086 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:31.913282 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1e3981a2-5a94-41d3-ab4b-d495927cb086 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:31.914788 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1e3981a2-5a94-41d3-ab4b-d495927cb086 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:31.915964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1e3981a2-5a94-41d3-ab4b-d495927cb086 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.163496 Jun 16 00:31:31.916694 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 314/612] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:31 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:32.455738 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=34 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:32.545137 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:32.934464 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-767042a2-9226-41a6-bbc5-da241d849ca1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:32.935052 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-767042a2-9226-41a6-bbc5-da241d849ca1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:32.942081 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-767042a2-9226-41a6-bbc5-da241d849ca1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:32.942528 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-767042a2-9226-41a6-bbc5-da241d849ca1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:32.943292 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-767042a2-9226-41a6-bbc5-da241d849ca1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:32.943752 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-767042a2-9226-41a6-bbc5-da241d849ca1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:33.077613 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-767042a2-9226-41a6-bbc5-da241d849ca1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:33.085956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-767042a2-9226-41a6-bbc5-da241d849ca1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:33.087443 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-767042a2-9226-41a6-bbc5-da241d849ca1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:33.088619 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-767042a2-9226-41a6-bbc5-da241d849ca1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.158060 Jun 16 00:31:33.089182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 315/613] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:32 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:34.106195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d184a014-561a-412b-bce3-220466f08f37 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:34.106862 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d184a014-561a-412b-bce3-220466f08f37 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:34.113315 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d184a014-561a-412b-bce3-220466f08f37 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:34.113764 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d184a014-561a-412b-bce3-220466f08f37 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:34.114527 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d184a014-561a-412b-bce3-220466f08f37 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:34.114966 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d184a014-561a-412b-bce3-220466f08f37 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:34.133228 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=100 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:34.245679 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d184a014-561a-412b-bce3-220466f08f37 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:34.254485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d184a014-561a-412b-bce3-220466f08f37 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:34.256013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d184a014-561a-412b-bce3-220466f08f37 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:34.257169 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d184a014-561a-412b-bce3-220466f08f37 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.154853 Jun 16 00:31:34.257721 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 316/614] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:34 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:34.932366 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-62f086e1-1b6e-47f6-af09-e8dc89215249 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:34.933387 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-62f086e1-1b6e-47f6-af09-e8dc89215249 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:34.939994 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-62f086e1-1b6e-47f6-af09-e8dc89215249 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:34.940443 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-62f086e1-1b6e-47f6-af09-e8dc89215249 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:34.941201 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-62f086e1-1b6e-47f6-af09-e8dc89215249 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:34.941634 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-62f086e1-1b6e-47f6-af09-e8dc89215249 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:35.012394 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-62f086e1-1b6e-47f6-af09-e8dc89215249 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "POST /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/action" status: 202 len: 0 microversion: 2.1 time: 0.083599 Jun 16 00:31:35.016208 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 317/615] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:31:34 2022] POST /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:31:35.021826 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6e3fb146-58fb-491e-b621-7c8c62390250 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:35.022510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-6e3fb146-58fb-491e-b621-7c8c62390250 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:35.028514 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6e3fb146-58fb-491e-b621-7c8c62390250 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:35.028972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6e3fb146-58fb-491e-b621-7c8c62390250 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:35.029725 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6e3fb146-58fb-491e-b621-7c8c62390250 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:35.030183 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6e3fb146-58fb-491e-b621-7c8c62390250 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:35.175044 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-6e3fb146-58fb-491e-b621-7c8c62390250 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:35.182950 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-6e3fb146-58fb-491e-b621-7c8c62390250 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1750 microversion: 2.1 time: 0.165198 Jun 16 00:31:35.183507 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 318/616] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:35 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:35.275484 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-29426f32-385d-49d2-9f03-1fe4ea4b09bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:35.276118 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-29426f32-385d-49d2-9f03-1fe4ea4b09bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:35.281952 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-29426f32-385d-49d2-9f03-1fe4ea4b09bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:35.282391 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-29426f32-385d-49d2-9f03-1fe4ea4b09bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:35.283148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-29426f32-385d-49d2-9f03-1fe4ea4b09bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:35.283581 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-29426f32-385d-49d2-9f03-1fe4ea4b09bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:35.412602 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-29426f32-385d-49d2-9f03-1fe4ea4b09bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:35.421551 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-29426f32-385d-49d2-9f03-1fe4ea4b09bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:35.423054 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-29426f32-385d-49d2-9f03-1fe4ea4b09bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:35.424229 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-29426f32-385d-49d2-9f03-1fe4ea4b09bc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.152401 Jun 16 00:31:35.424767 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 319/617] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:35 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:36.202017 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-946274c3-fde1-4ff5-bf7e-69d3ce500ce4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:36.203213 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-946274c3-fde1-4ff5-bf7e-69d3ce500ce4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:36.205566 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=52 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:36.211166 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-946274c3-fde1-4ff5-bf7e-69d3ce500ce4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:36.211668 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-946274c3-fde1-4ff5-bf7e-69d3ce500ce4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:36.212443 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-946274c3-fde1-4ff5-bf7e-69d3ce500ce4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:36.212882 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-946274c3-fde1-4ff5-bf7e-69d3ce500ce4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:36.353368 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-946274c3-fde1-4ff5-bf7e-69d3ce500ce4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:36.361284 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-946274c3-fde1-4ff5-bf7e-69d3ce500ce4 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1750 microversion: 2.1 time: 0.163333 Jun 16 00:31:36.361845 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 320/618] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:36 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:36.442472 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0441c7b7-3485-4b1c-9507-8b70e0828d59 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:36.443069 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0441c7b7-3485-4b1c-9507-8b70e0828d59 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:36.448983 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0441c7b7-3485-4b1c-9507-8b70e0828d59 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:36.449426 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0441c7b7-3485-4b1c-9507-8b70e0828d59 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:36.450178 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0441c7b7-3485-4b1c-9507-8b70e0828d59 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:36.450606 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0441c7b7-3485-4b1c-9507-8b70e0828d59 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:36.577115 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0441c7b7-3485-4b1c-9507-8b70e0828d59 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:36.585334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0441c7b7-3485-4b1c-9507-8b70e0828d59 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:36.586805 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0441c7b7-3485-4b1c-9507-8b70e0828d59 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:36.587968 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0441c7b7-3485-4b1c-9507-8b70e0828d59 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.149206 Jun 16 00:31:36.588513 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 321/619] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:36 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:37.378100 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3aac62e1-6011-4991-b52a-4053fe37e017 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:37.378766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-3aac62e1-6011-4991-b52a-4053fe37e017 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:37.385192 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3aac62e1-6011-4991-b52a-4053fe37e017 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:37.385633 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3aac62e1-6011-4991-b52a-4053fe37e017 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:37.386392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3aac62e1-6011-4991-b52a-4053fe37e017 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:37.386824 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3aac62e1-6011-4991-b52a-4053fe37e017 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:37.528192 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3aac62e1-6011-4991-b52a-4053fe37e017 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:37.537245 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3aac62e1-6011-4991-b52a-4053fe37e017 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1750 microversion: 2.1 time: 0.162923 Jun 16 00:31:37.537804 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 322/620] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:37 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:37.605373 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1fd4800e-5d62-41ec-bdfe-4e6de4da06f7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:37.605961 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1fd4800e-5d62-41ec-bdfe-4e6de4da06f7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:37.611784 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1fd4800e-5d62-41ec-bdfe-4e6de4da06f7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:37.612225 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1fd4800e-5d62-41ec-bdfe-4e6de4da06f7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:37.612976 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1fd4800e-5d62-41ec-bdfe-4e6de4da06f7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:37.613407 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1fd4800e-5d62-41ec-bdfe-4e6de4da06f7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:37.738992 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1fd4800e-5d62-41ec-bdfe-4e6de4da06f7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:37.747093 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1fd4800e-5d62-41ec-bdfe-4e6de4da06f7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:37.748622 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1fd4800e-5d62-41ec-bdfe-4e6de4da06f7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:37.750287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1fd4800e-5d62-41ec-bdfe-4e6de4da06f7 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.148515 Jun 16 00:31:37.750834 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 323/621] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:37 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:38.199101 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0bfe9ed5-82f1-4791-904e-430c449ee729 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "POST /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.857938 Jun 16 00:31:38.199707 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 299/622] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:31:22 2022] POST /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments => generated 194 bytes in 15859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:31:38.554177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1d05a35c-c1b6-4790-bb1c-9da755c392c3 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:38.554786 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1d05a35c-c1b6-4790-bb1c-9da755c392c3 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:38.561346 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1d05a35c-c1b6-4790-bb1c-9da755c392c3 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:38.561792 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1d05a35c-c1b6-4790-bb1c-9da755c392c3 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:38.562542 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1d05a35c-c1b6-4790-bb1c-9da755c392c3 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:38.562972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1d05a35c-c1b6-4790-bb1c-9da755c392c3 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:38.699120 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1d05a35c-c1b6-4790-bb1c-9da755c392c3 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:38.707837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1d05a35c-c1b6-4790-bb1c-9da755c392c3 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1750 microversion: 2.1 time: 0.157394 Jun 16 00:31:38.708389 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 324/623] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:38 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:38.769872 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3194fe55-87f6-49dd-a3c9-38e0707c3b6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:38.770553 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3194fe55-87f6-49dd-a3c9-38e0707c3b6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:38.776661 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3194fe55-87f6-49dd-a3c9-38e0707c3b6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:38.777106 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3194fe55-87f6-49dd-a3c9-38e0707c3b6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:38.777853 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3194fe55-87f6-49dd-a3c9-38e0707c3b6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:38.778279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3194fe55-87f6-49dd-a3c9-38e0707c3b6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:38.909771 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3194fe55-87f6-49dd-a3c9-38e0707c3b6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:38.918524 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3194fe55-87f6-49dd-a3c9-38e0707c3b6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:38.920059 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3194fe55-87f6-49dd-a3c9-38e0707c3b6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:38.921741 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3194fe55-87f6-49dd-a3c9-38e0707c3b6f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.157368 Jun 16 00:31:38.922292 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 300/624] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:38 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:39.724871 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-df53c21f-f9ac-427f-8525-19d67d595941 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:39.725470 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-df53c21f-f9ac-427f-8525-19d67d595941 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:39.732843 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-df53c21f-f9ac-427f-8525-19d67d595941 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:39.733297 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-df53c21f-f9ac-427f-8525-19d67d595941 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:39.734054 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-df53c21f-f9ac-427f-8525-19d67d595941 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:39.734485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-df53c21f-f9ac-427f-8525-19d67d595941 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:39.882195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-df53c21f-f9ac-427f-8525-19d67d595941 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:39.891196 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-df53c21f-f9ac-427f-8525-19d67d595941 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1750 microversion: 2.1 time: 0.169920 Jun 16 00:31:39.891456 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 325/625] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:39 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:39.941025 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-54172f5e-92b8-4956-a96d-a8c6f872ac49 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:39.941636 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-54172f5e-92b8-4956-a96d-a8c6f872ac49 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:39.948268 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-54172f5e-92b8-4956-a96d-a8c6f872ac49 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:39.948719 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-54172f5e-92b8-4956-a96d-a8c6f872ac49 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:39.949479 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-54172f5e-92b8-4956-a96d-a8c6f872ac49 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:39.949914 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-54172f5e-92b8-4956-a96d-a8c6f872ac49 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:40.086037 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-54172f5e-92b8-4956-a96d-a8c6f872ac49 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:40.095019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-54172f5e-92b8-4956-a96d-a8c6f872ac49 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:40.096542 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-54172f5e-92b8-4956-a96d-a8c6f872ac49 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:40.097903 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-54172f5e-92b8-4956-a96d-a8c6f872ac49 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.160488 Jun 16 00:31:40.098465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 301/626] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:39 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:40.908665 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7cf44a64-a6be-4e5a-aacb-a085492f7d1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:40.909190 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7cf44a64-a6be-4e5a-aacb-a085492f7d1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:40.915405 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7cf44a64-a6be-4e5a-aacb-a085492f7d1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:40.915885 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7cf44a64-a6be-4e5a-aacb-a085492f7d1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:40.916640 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7cf44a64-a6be-4e5a-aacb-a085492f7d1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:40.917068 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7cf44a64-a6be-4e5a-aacb-a085492f7d1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:41.057242 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7cf44a64-a6be-4e5a-aacb-a085492f7d1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:41.065516 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7cf44a64-a6be-4e5a-aacb-a085492f7d1d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1755 microversion: 2.1 time: 0.161234 Jun 16 00:31:41.066070 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 326/627] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:40 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:41.116596 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9739ffd7-1866-4b73-a563-826c9fd92cc6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:41.117224 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9739ffd7-1866-4b73-a563-826c9fd92cc6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:41.123652 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9739ffd7-1866-4b73-a563-826c9fd92cc6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:41.124294 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9739ffd7-1866-4b73-a563-826c9fd92cc6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:41.125054 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9739ffd7-1866-4b73-a563-826c9fd92cc6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:41.125485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9739ffd7-1866-4b73-a563-826c9fd92cc6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:41.257073 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9739ffd7-1866-4b73-a563-826c9fd92cc6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:41.265967 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9739ffd7-1866-4b73-a563-826c9fd92cc6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:41.267452 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9739ffd7-1866-4b73-a563-826c9fd92cc6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:41.268896 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9739ffd7-1866-4b73-a563-826c9fd92cc6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.155935 Jun 16 00:31:41.269450 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 302/628] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:41 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:42.082198 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-abb80417-dd7f-4f4b-9a68-01b46123c979 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:42.082722 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-abb80417-dd7f-4f4b-9a68-01b46123c979 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:42.089266 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-abb80417-dd7f-4f4b-9a68-01b46123c979 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:42.089712 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-abb80417-dd7f-4f4b-9a68-01b46123c979 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:42.090478 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-abb80417-dd7f-4f4b-9a68-01b46123c979 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:42.090913 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-abb80417-dd7f-4f4b-9a68-01b46123c979 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:42.233789 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-abb80417-dd7f-4f4b-9a68-01b46123c979 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:42.241643 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-abb80417-dd7f-4f4b-9a68-01b46123c979 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1755 microversion: 2.1 time: 0.163345 Jun 16 00:31:42.242196 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 327/629] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:42 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:42.286740 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e6f31e90-4238-4a8d-94e0-9ce6e7f33df6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:42.287347 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e6f31e90-4238-4a8d-94e0-9ce6e7f33df6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:42.293727 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e6f31e90-4238-4a8d-94e0-9ce6e7f33df6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:42.294197 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e6f31e90-4238-4a8d-94e0-9ce6e7f33df6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:42.294958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e6f31e90-4238-4a8d-94e0-9ce6e7f33df6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:42.295394 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e6f31e90-4238-4a8d-94e0-9ce6e7f33df6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:42.424595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e6f31e90-4238-4a8d-94e0-9ce6e7f33df6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:42.432982 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e6f31e90-4238-4a8d-94e0-9ce6e7f33df6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:42.434480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e6f31e90-4238-4a8d-94e0-9ce6e7f33df6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:42.435647 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e6f31e90-4238-4a8d-94e0-9ce6e7f33df6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.152802 Jun 16 00:31:42.437107 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 303/630] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:42 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:43.258919 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5135312c-b0cd-48c8-ad75-289d09f0c779 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:43.259510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5135312c-b0cd-48c8-ad75-289d09f0c779 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:43.266161 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5135312c-b0cd-48c8-ad75-289d09f0c779 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:43.266606 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5135312c-b0cd-48c8-ad75-289d09f0c779 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:43.267366 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5135312c-b0cd-48c8-ad75-289d09f0c779 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:43.267832 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5135312c-b0cd-48c8-ad75-289d09f0c779 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:43.410113 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5135312c-b0cd-48c8-ad75-289d09f0c779 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:43.418096 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5135312c-b0cd-48c8-ad75-289d09f0c779 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1755 microversion: 2.1 time: 0.163202 Jun 16 00:31:43.418654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 328/631] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:43 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:43.453620 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7290248c-f767-43bb-9441-0a45fa83ff3b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:43.454246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7290248c-f767-43bb-9441-0a45fa83ff3b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:43.460706 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7290248c-f767-43bb-9441-0a45fa83ff3b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:43.461159 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7290248c-f767-43bb-9441-0a45fa83ff3b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:43.461918 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7290248c-f767-43bb-9441-0a45fa83ff3b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:43.462354 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7290248c-f767-43bb-9441-0a45fa83ff3b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:43.588045 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7290248c-f767-43bb-9441-0a45fa83ff3b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:43.596992 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7290248c-f767-43bb-9441-0a45fa83ff3b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:43.598490 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7290248c-f767-43bb-9441-0a45fa83ff3b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:43.599648 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7290248c-f767-43bb-9441-0a45fa83ff3b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.150474 Jun 16 00:31:43.600197 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 304/632] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:43 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:44.435370 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-99c35196-a152-468c-bafc-df294fe9fcae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:44.436013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-99c35196-a152-468c-bafc-df294fe9fcae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:44.442918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-99c35196-a152-468c-bafc-df294fe9fcae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:44.443363 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-99c35196-a152-468c-bafc-df294fe9fcae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:44.444155 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-99c35196-a152-468c-bafc-df294fe9fcae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:44.444591 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-99c35196-a152-468c-bafc-df294fe9fcae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:44.588171 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-99c35196-a152-468c-bafc-df294fe9fcae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:44.596598 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-99c35196-a152-468c-bafc-df294fe9fcae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1755 microversion: 2.1 time: 0.165086 Jun 16 00:31:44.597152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 329/633] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:44 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:44.617610 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7e528e95-5772-4508-8638-aa0908ffd13c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:44.618214 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7e528e95-5772-4508-8638-aa0908ffd13c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:44.625241 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7e528e95-5772-4508-8638-aa0908ffd13c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:44.625687 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7e528e95-5772-4508-8638-aa0908ffd13c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:44.626461 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7e528e95-5772-4508-8638-aa0908ffd13c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:44.626897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7e528e95-5772-4508-8638-aa0908ffd13c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:44.751976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7e528e95-5772-4508-8638-aa0908ffd13c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:44.760233 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7e528e95-5772-4508-8638-aa0908ffd13c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:44.761716 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7e528e95-5772-4508-8638-aa0908ffd13c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:44.762864 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7e528e95-5772-4508-8638-aa0908ffd13c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.149179 Jun 16 00:31:44.763446 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 305/634] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:44 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:45.613812 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5663f361-6a60-4f1e-9a37-b69186b65d38 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:45.614683 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5663f361-6a60-4f1e-9a37-b69186b65d38 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:45.621644 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5663f361-6a60-4f1e-9a37-b69186b65d38 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:45.622095 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5663f361-6a60-4f1e-9a37-b69186b65d38 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:45.622853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5663f361-6a60-4f1e-9a37-b69186b65d38 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:45.623463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5663f361-6a60-4f1e-9a37-b69186b65d38 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:45.762056 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5663f361-6a60-4f1e-9a37-b69186b65d38 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:45.770339 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5663f361-6a60-4f1e-9a37-b69186b65d38 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1755 microversion: 2.1 time: 0.160511 Jun 16 00:31:45.770888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 330/635] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:45 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:45.781782 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9cda403f-686a-4147-972e-0acc15417c36 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:45.782388 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9cda403f-686a-4147-972e-0acc15417c36 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:45.788861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9cda403f-686a-4147-972e-0acc15417c36 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:45.789308 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9cda403f-686a-4147-972e-0acc15417c36 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:45.790071 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9cda403f-686a-4147-972e-0acc15417c36 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:45.790533 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9cda403f-686a-4147-972e-0acc15417c36 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:45.918212 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9cda403f-686a-4147-972e-0acc15417c36 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:45.927103 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9cda403f-686a-4147-972e-0acc15417c36 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:45.928619 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9cda403f-686a-4147-972e-0acc15417c36 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:45.929770 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9cda403f-686a-4147-972e-0acc15417c36 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.151870 Jun 16 00:31:45.930319 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 306/636] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:45 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:46.786732 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fdf8ed0c-40b7-45da-8e62-768ba12e5dd9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:46.787375 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fdf8ed0c-40b7-45da-8e62-768ba12e5dd9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:46.793993 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fdf8ed0c-40b7-45da-8e62-768ba12e5dd9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:46.794444 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fdf8ed0c-40b7-45da-8e62-768ba12e5dd9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:46.795219 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fdf8ed0c-40b7-45da-8e62-768ba12e5dd9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:46.795684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fdf8ed0c-40b7-45da-8e62-768ba12e5dd9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:46.932815 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fdf8ed0c-40b7-45da-8e62-768ba12e5dd9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:46.941268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fdf8ed0c-40b7-45da-8e62-768ba12e5dd9 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1755 microversion: 2.1 time: 0.158386 Jun 16 00:31:46.942116 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 331/637] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:46 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:46.946991 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4794b892-0205-416a-965e-54002a1f7d39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:46.947595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4794b892-0205-416a-965e-54002a1f7d39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:46.954628 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4794b892-0205-416a-965e-54002a1f7d39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:46.955076 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4794b892-0205-416a-965e-54002a1f7d39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:46.955868 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4794b892-0205-416a-965e-54002a1f7d39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:46.956308 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4794b892-0205-416a-965e-54002a1f7d39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:47.083310 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4794b892-0205-416a-965e-54002a1f7d39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:47.091589 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4794b892-0205-416a-965e-54002a1f7d39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:47.093099 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4794b892-0205-416a-965e-54002a1f7d39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:47.094233 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4794b892-0205-416a-965e-54002a1f7d39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.151059 Jun 16 00:31:47.094786 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 307/638] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:46 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:47.958679 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-31700716-87d2-49cd-8e24-0715a830f65b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:47.959292 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-31700716-87d2-49cd-8e24-0715a830f65b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:47.966059 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-31700716-87d2-49cd-8e24-0715a830f65b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:47.966506 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-31700716-87d2-49cd-8e24-0715a830f65b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:47.967268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-31700716-87d2-49cd-8e24-0715a830f65b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:47.968364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-31700716-87d2-49cd-8e24-0715a830f65b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:47.972339 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:48.106839 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-31700716-87d2-49cd-8e24-0715a830f65b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:48.112547 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9084cd34-653d-4d54-9c71-e3d6658755ec tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:48.113163 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9084cd34-653d-4d54-9c71-e3d6658755ec tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:48.114882 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-31700716-87d2-49cd-8e24-0715a830f65b tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1755 microversion: 2.1 time: 0.160059 Jun 16 00:31:48.115444 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 332/639] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:47 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:48.119989 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9084cd34-653d-4d54-9c71-e3d6658755ec tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:48.120430 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9084cd34-653d-4d54-9c71-e3d6658755ec tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:48.121214 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9084cd34-653d-4d54-9c71-e3d6658755ec tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:48.121648 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9084cd34-653d-4d54-9c71-e3d6658755ec tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:48.251081 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9084cd34-653d-4d54-9c71-e3d6658755ec tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:48.259326 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9084cd34-653d-4d54-9c71-e3d6658755ec tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:48.260833 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9084cd34-653d-4d54-9c71-e3d6658755ec tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:48.261965 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9084cd34-653d-4d54-9c71-e3d6658755ec tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.153356 Jun 16 00:31:48.262514 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 308/640] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:48 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:48.831168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-af83efbb-9be7-46ca-88cd-d4a495925112 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:48.832196 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-af83efbb-9be7-46ca-88cd-d4a495925112 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:48.838257 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-af83efbb-9be7-46ca-88cd-d4a495925112 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:48.838706 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-af83efbb-9be7-46ca-88cd-d4a495925112 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:48.839466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-af83efbb-9be7-46ca-88cd-d4a495925112 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:48.839934 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-af83efbb-9be7-46ca-88cd-d4a495925112 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:48.862424 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.objects.instance [None req-af83efbb-9be7-46ca-88cd-d4a495925112 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lazy-loading 'flavor' on Instance uuid f4a2ac88-a177-4fc8-867b-eef87107e914 {{(pid=129466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:31:48.984985 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-af83efbb-9be7-46ca-88cd-d4a495925112 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "POST /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/action" status: 200 len: 32 microversion: 2.1 time: 0.158112 Jun 16 00:31:48.985621 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 333/641] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:31:48 2022] POST /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:31:48.994620 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2f5e731b-57c0-48e3-9d5b-ae0f33264b2c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:48.995223 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2f5e731b-57c0-48e3-9d5b-ae0f33264b2c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:49.001910 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2f5e731b-57c0-48e3-9d5b-ae0f33264b2c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:49.002363 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2f5e731b-57c0-48e3-9d5b-ae0f33264b2c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:49.003221 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2f5e731b-57c0-48e3-9d5b-ae0f33264b2c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:49.003677 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2f5e731b-57c0-48e3-9d5b-ae0f33264b2c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:49.133048 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c216ba61-01c3-4de5-a340-13555122e613 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:49.133777 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c216ba61-01c3-4de5-a340-13555122e613 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:49.135537 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2f5e731b-57c0-48e3-9d5b-ae0f33264b2c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:49.141060 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c216ba61-01c3-4de5-a340-13555122e613 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:49.141520 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c216ba61-01c3-4de5-a340-13555122e613 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:49.142300 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c216ba61-01c3-4de5-a340-13555122e613 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:49.142739 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c216ba61-01c3-4de5-a340-13555122e613 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:49.144740 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2f5e731b-57c0-48e3-9d5b-ae0f33264b2c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.153919 Jun 16 00:31:49.145305 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 309/642] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:48 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:49.281252 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-cd6dd460-8037-4a3d-9dfb-e809ab51e9da tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:49.281883 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-cd6dd460-8037-4a3d-9dfb-e809ab51e9da tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:49.284909 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c216ba61-01c3-4de5-a340-13555122e613 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:49.293529 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c216ba61-01c3-4de5-a340-13555122e613 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1755 microversion: 2.1 time: 0.164704 Jun 16 00:31:49.294054 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cd6dd460-8037-4a3d-9dfb-e809ab51e9da tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:49.294582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 334/643] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:49 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:49.294704 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cd6dd460-8037-4a3d-9dfb-e809ab51e9da tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:49.295288 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cd6dd460-8037-4a3d-9dfb-e809ab51e9da tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:49.296253 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cd6dd460-8037-4a3d-9dfb-e809ab51e9da tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:49.441884 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-cd6dd460-8037-4a3d-9dfb-e809ab51e9da tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:49.458047 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-cd6dd460-8037-4a3d-9dfb-e809ab51e9da tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:49.459839 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-cd6dd460-8037-4a3d-9dfb-e809ab51e9da tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:49.461236 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-cd6dd460-8037-4a3d-9dfb-e809ab51e9da tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.183844 Jun 16 00:31:49.461804 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 310/644] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:49 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:50.161917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-aac4822f-a735-43b6-8b1e-03cde017d999 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:50.162451 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-aac4822f-a735-43b6-8b1e-03cde017d999 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:50.168983 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aac4822f-a735-43b6-8b1e-03cde017d999 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:50.169524 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aac4822f-a735-43b6-8b1e-03cde017d999 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:50.170277 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aac4822f-a735-43b6-8b1e-03cde017d999 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:50.171200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aac4822f-a735-43b6-8b1e-03cde017d999 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:50.306280 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-aac4822f-a735-43b6-8b1e-03cde017d999 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:50.313019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b57554cf-78e6-4c98-a092-ffd948f91aae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:50.313821 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b57554cf-78e6-4c98-a092-ffd948f91aae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:50.315194 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-aac4822f-a735-43b6-8b1e-03cde017d999 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.157200 Jun 16 00:31:50.324691 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 335/645] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:50 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:50.324884 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b57554cf-78e6-4c98-a092-ffd948f91aae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:50.324884 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b57554cf-78e6-4c98-a092-ffd948f91aae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:50.324884 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b57554cf-78e6-4c98-a092-ffd948f91aae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:50.324884 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b57554cf-78e6-4c98-a092-ffd948f91aae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:50.464646 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b57554cf-78e6-4c98-a092-ffd948f91aae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:50.472916 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b57554cf-78e6-4c98-a092-ffd948f91aae tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1755 microversion: 2.1 time: 0.164605 Jun 16 00:31:50.473598 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 311/646] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:50 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:31:50.479516 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3b915cf8-66d5-4a01-ba31-65e74fcfc124 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:50.480171 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-3b915cf8-66d5-4a01-ba31-65e74fcfc124 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:50.486085 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3b915cf8-66d5-4a01-ba31-65e74fcfc124 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:50.486525 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3b915cf8-66d5-4a01-ba31-65e74fcfc124 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:50.487282 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3b915cf8-66d5-4a01-ba31-65e74fcfc124 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:50.487738 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3b915cf8-66d5-4a01-ba31-65e74fcfc124 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:50.612306 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3b915cf8-66d5-4a01-ba31-65e74fcfc124 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:50.620501 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3b915cf8-66d5-4a01-ba31-65e74fcfc124 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:50.621969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3b915cf8-66d5-4a01-ba31-65e74fcfc124 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:50.623114 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3b915cf8-66d5-4a01-ba31-65e74fcfc124 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.147472 Jun 16 00:31:50.624195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 336/647] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:50 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:51.332349 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e01efb78-7d20-41ed-933a-5761e367bf3c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:51.332962 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e01efb78-7d20-41ed-933a-5761e367bf3c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:51.339372 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e01efb78-7d20-41ed-933a-5761e367bf3c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:51.339863 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e01efb78-7d20-41ed-933a-5761e367bf3c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:51.340640 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e01efb78-7d20-41ed-933a-5761e367bf3c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:51.341084 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e01efb78-7d20-41ed-933a-5761e367bf3c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:51.468378 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e01efb78-7d20-41ed-933a-5761e367bf3c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:51.476211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e01efb78-7d20-41ed-933a-5761e367bf3c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.147766 Jun 16 00:31:51.476773 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 312/648] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:51 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:51.493066 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-15b96a07-c22e-4e65-9fd6-d606495a0fbe tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:51.493672 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-15b96a07-c22e-4e65-9fd6-d606495a0fbe tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:51.500104 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-15b96a07-c22e-4e65-9fd6-d606495a0fbe tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:51.500555 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-15b96a07-c22e-4e65-9fd6-d606495a0fbe tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:51.501306 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-15b96a07-c22e-4e65-9fd6-d606495a0fbe tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:51.501734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-15b96a07-c22e-4e65-9fd6-d606495a0fbe tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:51.640524 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-15b96a07-c22e-4e65-9fd6-d606495a0fbe tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:51.647827 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6d8004d8-9cd4-41c3-80d8-9e2da856e615 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:51.648773 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-15b96a07-c22e-4e65-9fd6-d606495a0fbe tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1755 microversion: 2.1 time: 0.159462 Jun 16 00:31:51.649046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6d8004d8-9cd4-41c3-80d8-9e2da856e615 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:51.649337 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 337/649] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:51 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:51.656371 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6d8004d8-9cd4-41c3-80d8-9e2da856e615 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:51.656965 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6d8004d8-9cd4-41c3-80d8-9e2da856e615 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:51.657733 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6d8004d8-9cd4-41c3-80d8-9e2da856e615 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:51.658165 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6d8004d8-9cd4-41c3-80d8-9e2da856e615 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:51.754175 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-3e523f97-d110-43dc-aa50-daeb0acc691e req-379df7cb-1de5-4091-917f-69bede58b8bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b84afb6-466c-477a-9339-b4a0ecef36be", "name": "network-vif-plugged", "status": "completed", "tag": "f807a98a-f8e6-4868-ab21-4008a07a1ae4"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:31:51.766543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-3e523f97-d110-43dc-aa50-daeb0acc691e req-379df7cb-1de5-4091-917f-69bede58b8bc service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:51.769063 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-3e523f97-d110-43dc-aa50-daeb0acc691e req-379df7cb-1de5-4091-917f-69bede58b8bc service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:51.788915 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-3e523f97-d110-43dc-aa50-daeb0acc691e req-379df7cb-1de5-4091-917f-69bede58b8bc service nova] Creating event network-vif-plugged:f807a98a-f8e6-4868-ab21-4008a07a1ae4 for instance 7b84afb6-466c-477a-9339-b4a0ecef36be on hv-cinder-84327 Jun 16 00:31:51.794204 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-3e523f97-d110-43dc-aa50-daeb0acc691e req-379df7cb-1de5-4091-917f-69bede58b8bc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043699 Jun 16 00:31:51.795901 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 338/650] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:31:51.801747 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6d8004d8-9cd4-41c3-80d8-9e2da856e615 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:51.810208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6d8004d8-9cd4-41c3-80d8-9e2da856e615 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:51.811796 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6d8004d8-9cd4-41c3-80d8-9e2da856e615 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:51.812962 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6d8004d8-9cd4-41c3-80d8-9e2da856e615 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.170103 Jun 16 00:31:51.813510 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 313/651] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:51 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:52.494389 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-283d47a1-17a8-4723-9dad-882ef117698e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:52.495193 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-283d47a1-17a8-4723-9dad-882ef117698e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:52.502495 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-283d47a1-17a8-4723-9dad-882ef117698e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:52.502949 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-283d47a1-17a8-4723-9dad-882ef117698e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:52.503761 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-283d47a1-17a8-4723-9dad-882ef117698e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:52.504205 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-283d47a1-17a8-4723-9dad-882ef117698e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:52.638258 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-283d47a1-17a8-4723-9dad-882ef117698e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:52.646660 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-283d47a1-17a8-4723-9dad-882ef117698e tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.156522 Jun 16 00:31:52.647227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 339/652] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:52 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:52.666295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6fe835e3-7855-4f48-8669-8f38ad56532d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:52.667227 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6fe835e3-7855-4f48-8669-8f38ad56532d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:52.674416 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6fe835e3-7855-4f48-8669-8f38ad56532d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:52.674866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6fe835e3-7855-4f48-8669-8f38ad56532d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:52.675653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6fe835e3-7855-4f48-8669-8f38ad56532d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:52.676091 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6fe835e3-7855-4f48-8669-8f38ad56532d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:52.814137 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6fe835e3-7855-4f48-8669-8f38ad56532d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:52.821984 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6fe835e3-7855-4f48-8669-8f38ad56532d tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1755 microversion: 2.1 time: 0.159582 Jun 16 00:31:52.822543 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 314/653] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:52 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:52.830023 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8c71c38d-63c7-4b37-a550-158ee5986696 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:52.830618 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8c71c38d-63c7-4b37-a550-158ee5986696 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:52.836681 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c71c38d-63c7-4b37-a550-158ee5986696 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:52.837124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c71c38d-63c7-4b37-a550-158ee5986696 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:52.837878 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c71c38d-63c7-4b37-a550-158ee5986696 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:52.838308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c71c38d-63c7-4b37-a550-158ee5986696 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:52.965594 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8c71c38d-63c7-4b37-a550-158ee5986696 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:52.974299 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8c71c38d-63c7-4b37-a550-158ee5986696 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:52.975816 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8c71c38d-63c7-4b37-a550-158ee5986696 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:52.976955 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8c71c38d-63c7-4b37-a550-158ee5986696 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.150770 Jun 16 00:31:52.977492 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 340/654] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:52 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:53.664703 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8fa4d428-541d-4f15-970a-179321db0379 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:53.665524 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8fa4d428-541d-4f15-970a-179321db0379 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:53.673281 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8fa4d428-541d-4f15-970a-179321db0379 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:53.673884 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8fa4d428-541d-4f15-970a-179321db0379 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:53.674472 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8fa4d428-541d-4f15-970a-179321db0379 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:53.674901 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8fa4d428-541d-4f15-970a-179321db0379 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:53.678856 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:53.803716 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8fa4d428-541d-4f15-970a-179321db0379 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:53.811659 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8fa4d428-541d-4f15-970a-179321db0379 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.150870 Jun 16 00:31:53.812875 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 315/655] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:53 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:53.838970 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-50ef445b-a15e-400b-9bec-8ed06a9e72fc tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:53.839580 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-50ef445b-a15e-400b-9bec-8ed06a9e72fc tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:53.845990 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-50ef445b-a15e-400b-9bec-8ed06a9e72fc tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:53.846440 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-50ef445b-a15e-400b-9bec-8ed06a9e72fc tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:53.847197 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-50ef445b-a15e-400b-9bec-8ed06a9e72fc tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:53.847659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-50ef445b-a15e-400b-9bec-8ed06a9e72fc tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:53.985844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-50ef445b-a15e-400b-9bec-8ed06a9e72fc tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:53.993869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-50ef445b-a15e-400b-9bec-8ed06a9e72fc tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1758 microversion: 2.1 time: 0.158601 Jun 16 00:31:53.994429 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 341/656] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:53 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:53.994834 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6dc96f5a-cada-4610-92df-371cc38f06b1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:53.995577 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6dc96f5a-cada-4610-92df-371cc38f06b1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:54.002159 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6dc96f5a-cada-4610-92df-371cc38f06b1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.002613 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6dc96f5a-cada-4610-92df-371cc38f06b1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.003379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6dc96f5a-cada-4610-92df-371cc38f06b1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.003849 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6dc96f5a-cada-4610-92df-371cc38f06b1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.134861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6dc96f5a-cada-4610-92df-371cc38f06b1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:54.143166 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6dc96f5a-cada-4610-92df-371cc38f06b1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:54.144935 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6dc96f5a-cada-4610-92df-371cc38f06b1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:54.146075 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6dc96f5a-cada-4610-92df-371cc38f06b1 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.155149 Jun 16 00:31:54.146624 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 316/657] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:53 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:31:54.829579 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8c61beb5-900e-4436-b9c4-3f5fd7baef27 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:54.830184 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8c61beb5-900e-4436-b9c4-3f5fd7baef27 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:54.836099 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c61beb5-900e-4436-b9c4-3f5fd7baef27 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.836555 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c61beb5-900e-4436-b9c4-3f5fd7baef27 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.837315 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c61beb5-900e-4436-b9c4-3f5fd7baef27 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:54.837752 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c61beb5-900e-4436-b9c4-3f5fd7baef27 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:54.977218 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8c61beb5-900e-4436-b9c4-3f5fd7baef27 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:54.985485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8c61beb5-900e-4436-b9c4-3f5fd7baef27 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.160063 Jun 16 00:31:54.986119 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 342/658] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:54 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:55.164715 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-733bbee3-3c07-4391-9392-12b878d64867 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:55.165400 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-733bbee3-3c07-4391-9392-12b878d64867 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:55.172131 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-733bbee3-3c07-4391-9392-12b878d64867 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:55.172579 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-733bbee3-3c07-4391-9392-12b878d64867 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:55.173344 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-733bbee3-3c07-4391-9392-12b878d64867 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:55.173906 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-733bbee3-3c07-4391-9392-12b878d64867 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:55.307752 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-733bbee3-3c07-4391-9392-12b878d64867 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:55.316413 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-733bbee3-3c07-4391-9392-12b878d64867 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:55.317904 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-733bbee3-3c07-4391-9392-12b878d64867 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:55.319062 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-733bbee3-3c07-4391-9392-12b878d64867 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1808 microversion: 2.20 time: 0.158228 Jun 16 00:31:55.319633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 317/659] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:55 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:56.002091 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-78079148-56e3-4156-be12-599ea01b9140 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:56.002629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-78079148-56e3-4156-be12-599ea01b9140 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:56.009172 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78079148-56e3-4156-be12-599ea01b9140 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:56.009628 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78079148-56e3-4156-be12-599ea01b9140 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:56.010392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78079148-56e3-4156-be12-599ea01b9140 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:56.010835 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78079148-56e3-4156-be12-599ea01b9140 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:56.135098 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-78079148-56e3-4156-be12-599ea01b9140 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:56.142973 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-78079148-56e3-4156-be12-599ea01b9140 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.145308 Jun 16 00:31:56.143537 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 343/660] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:55 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:56.337740 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-32f8a54d-4d3f-468a-922e-52a5a1da0584 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:56.338258 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-32f8a54d-4d3f-468a-922e-52a5a1da0584 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:56.345279 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-32f8a54d-4d3f-468a-922e-52a5a1da0584 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:56.345728 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-32f8a54d-4d3f-468a-922e-52a5a1da0584 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:56.346488 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-32f8a54d-4d3f-468a-922e-52a5a1da0584 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:56.346922 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-32f8a54d-4d3f-468a-922e-52a5a1da0584 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:56.476633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-32f8a54d-4d3f-468a-922e-52a5a1da0584 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:56.485529 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-32f8a54d-4d3f-468a-922e-52a5a1da0584 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:56.487000 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-32f8a54d-4d3f-468a-922e-52a5a1da0584 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:56.488174 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-32f8a54d-4d3f-468a-922e-52a5a1da0584 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1795 microversion: 2.20 time: 0.154425 Jun 16 00:31:56.488728 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 318/661] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:31:56 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1795 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:31:57.160177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-abe22008-39f4-49ca-aa6d-5cf203312ebc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:57.160713 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-abe22008-39f4-49ca-aa6d-5cf203312ebc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:57.167192 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-abe22008-39f4-49ca-aa6d-5cf203312ebc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:57.167666 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-abe22008-39f4-49ca-aa6d-5cf203312ebc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:57.168441 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-abe22008-39f4-49ca-aa6d-5cf203312ebc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:57.168882 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-abe22008-39f4-49ca-aa6d-5cf203312ebc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:57.293299 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-abe22008-39f4-49ca-aa6d-5cf203312ebc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:57.301881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-abe22008-39f4-49ca-aa6d-5cf203312ebc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.145610 Jun 16 00:31:57.302440 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 344/662] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:57 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:58.319247 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-96763f1e-f867-43a5-85d4-385fc1de7cb0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:58.319867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-96763f1e-f867-43a5-85d4-385fc1de7cb0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:58.326557 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-96763f1e-f867-43a5-85d4-385fc1de7cb0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:58.327006 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-96763f1e-f867-43a5-85d4-385fc1de7cb0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:58.327822 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-96763f1e-f867-43a5-85d4-385fc1de7cb0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:58.328255 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-96763f1e-f867-43a5-85d4-385fc1de7cb0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:58.454837 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-96763f1e-f867-43a5-85d4-385fc1de7cb0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:58.462745 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-96763f1e-f867-43a5-85d4-385fc1de7cb0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.147364 Jun 16 00:31:58.463303 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 319/663] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:58 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:31:59.480043 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-60d31f3c-4d2f-4b49-9a9f-2ee392ccdb3d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:31:59.480646 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-60d31f3c-4d2f-4b49-9a9f-2ee392ccdb3d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:31:59.487200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-60d31f3c-4d2f-4b49-9a9f-2ee392ccdb3d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:59.487671 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-60d31f3c-4d2f-4b49-9a9f-2ee392ccdb3d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:59.488439 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-60d31f3c-4d2f-4b49-9a9f-2ee392ccdb3d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:31:59.488878 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-60d31f3c-4d2f-4b49-9a9f-2ee392ccdb3d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:31:59.616466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-60d31f3c-4d2f-4b49-9a9f-2ee392ccdb3d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:31:59.625013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-60d31f3c-4d2f-4b49-9a9f-2ee392ccdb3d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.148281 Jun 16 00:31:59.625579 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 345/664] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:31:59 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:00.641832 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a3db883b-d185-4f12-8496-6de8df14280c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:00.642475 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a3db883b-d185-4f12-8496-6de8df14280c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:00.649295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a3db883b-d185-4f12-8496-6de8df14280c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:00.649740 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a3db883b-d185-4f12-8496-6de8df14280c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:00.650495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a3db883b-d185-4f12-8496-6de8df14280c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:00.650925 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a3db883b-d185-4f12-8496-6de8df14280c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:00.775149 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a3db883b-d185-4f12-8496-6de8df14280c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:00.783012 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a3db883b-d185-4f12-8496-6de8df14280c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.144982 Jun 16 00:32:00.783582 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 320/665] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:00 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:01.800051 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f1634c7a-7afb-49ca-9889-d86e8709f2bb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:01.800785 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f1634c7a-7afb-49ca-9889-d86e8709f2bb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:01.807285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f1634c7a-7afb-49ca-9889-d86e8709f2bb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:01.807769 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f1634c7a-7afb-49ca-9889-d86e8709f2bb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:01.808530 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f1634c7a-7afb-49ca-9889-d86e8709f2bb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:01.808967 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f1634c7a-7afb-49ca-9889-d86e8709f2bb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:01.936844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f1634c7a-7afb-49ca-9889-d86e8709f2bb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:01.945207 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f1634c7a-7afb-49ca-9889-d86e8709f2bb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.149036 Jun 16 00:32:01.945764 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 346/666] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:01 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:02.962200 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-11c33f30-5c31-405f-b126-54215dce333a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:02.962813 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-11c33f30-5c31-405f-b126-54215dce333a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:02.965170 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=43 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:02.970985 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-11c33f30-5c31-405f-b126-54215dce333a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:02.971435 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-11c33f30-5c31-405f-b126-54215dce333a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:02.972220 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-11c33f30-5c31-405f-b126-54215dce333a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:02.972652 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-11c33f30-5c31-405f-b126-54215dce333a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:03.096579 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-11c33f30-5c31-405f-b126-54215dce333a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:03.104398 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-11c33f30-5c31-405f-b126-54215dce333a tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.146072 Jun 16 00:32:03.104958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 321/667] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:02 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:04.121467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f67cff0b-2621-4c5c-a3c1-89f9e2ac7278 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:04.122029 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f67cff0b-2621-4c5c-a3c1-89f9e2ac7278 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:04.128608 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f67cff0b-2621-4c5c-a3c1-89f9e2ac7278 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:04.129058 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f67cff0b-2621-4c5c-a3c1-89f9e2ac7278 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:04.129827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f67cff0b-2621-4c5c-a3c1-89f9e2ac7278 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:04.130265 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f67cff0b-2621-4c5c-a3c1-89f9e2ac7278 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:04.148078 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:04.261438 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f67cff0b-2621-4c5c-a3c1-89f9e2ac7278 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:04.270199 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f67cff0b-2621-4c5c-a3c1-89f9e2ac7278 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.152696 Jun 16 00:32:04.270771 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 347/668] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:04 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:05.286983 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e926a9fb-80bb-48b8-a04a-2c2fb06a28ec tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:05.287584 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e926a9fb-80bb-48b8-a04a-2c2fb06a28ec tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:05.294001 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e926a9fb-80bb-48b8-a04a-2c2fb06a28ec tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:05.294453 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e926a9fb-80bb-48b8-a04a-2c2fb06a28ec tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:05.295214 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e926a9fb-80bb-48b8-a04a-2c2fb06a28ec tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:05.295671 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e926a9fb-80bb-48b8-a04a-2c2fb06a28ec tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:05.423794 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e926a9fb-80bb-48b8-a04a-2c2fb06a28ec tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:05.431648 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e926a9fb-80bb-48b8-a04a-2c2fb06a28ec tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.148515 Jun 16 00:32:05.432567 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 322/669] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:05 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:06.450097 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fc04bb58-faa4-4759-a8f5-b7e012c81c70 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:06.450705 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fc04bb58-faa4-4759-a8f5-b7e012c81c70 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:06.453115 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=56 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:06.458427 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fc04bb58-faa4-4759-a8f5-b7e012c81c70 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:06.458873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fc04bb58-faa4-4759-a8f5-b7e012c81c70 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:06.459652 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fc04bb58-faa4-4759-a8f5-b7e012c81c70 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:06.460087 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fc04bb58-faa4-4759-a8f5-b7e012c81c70 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:06.583867 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fc04bb58-faa4-4759-a8f5-b7e012c81c70 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:06.591735 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fc04bb58-faa4-4759-a8f5-b7e012c81c70 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.145408 Jun 16 00:32:06.592292 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 348/670] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:06 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:07.610224 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6385f017-616b-48d5-8a5d-c1c80ea85086 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:07.610732 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6385f017-616b-48d5-8a5d-c1c80ea85086 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:07.617535 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6385f017-616b-48d5-8a5d-c1c80ea85086 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:07.617976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6385f017-616b-48d5-8a5d-c1c80ea85086 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:07.618729 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6385f017-616b-48d5-8a5d-c1c80ea85086 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:07.619158 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6385f017-616b-48d5-8a5d-c1c80ea85086 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:07.750175 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6385f017-616b-48d5-8a5d-c1c80ea85086 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:07.758039 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6385f017-616b-48d5-8a5d-c1c80ea85086 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.152342 Jun 16 00:32:07.758728 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 323/671] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:07 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:08.775756 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b22c1b97-b4fa-4e76-b6c9-1764b6a18963 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:08.776382 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b22c1b97-b4fa-4e76-b6c9-1764b6a18963 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:08.782849 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b22c1b97-b4fa-4e76-b6c9-1764b6a18963 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:08.783333 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b22c1b97-b4fa-4e76-b6c9-1764b6a18963 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:08.784122 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b22c1b97-b4fa-4e76-b6c9-1764b6a18963 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:08.784561 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b22c1b97-b4fa-4e76-b6c9-1764b6a18963 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:08.910747 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b22c1b97-b4fa-4e76-b6c9-1764b6a18963 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:08.918580 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b22c1b97-b4fa-4e76-b6c9-1764b6a18963 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1737 microversion: 2.1 time: 0.146813 Jun 16 00:32:08.919141 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 349/672] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:08 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:09.936499 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1c3cdd2d-e5aa-42f8-bd43-ad1864649200 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:09.937614 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1c3cdd2d-e5aa-42f8-bd43-ad1864649200 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:09.944073 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1c3cdd2d-e5aa-42f8-bd43-ad1864649200 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:09.944521 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1c3cdd2d-e5aa-42f8-bd43-ad1864649200 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:09.945291 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1c3cdd2d-e5aa-42f8-bd43-ad1864649200 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:09.945725 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1c3cdd2d-e5aa-42f8-bd43-ad1864649200 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:10.073913 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1c3cdd2d-e5aa-42f8-bd43-ad1864649200 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:10.082701 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1c3cdd2d-e5aa-42f8-bd43-ad1864649200 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1717 microversion: 2.1 time: 0.150347 Jun 16 00:32:10.083275 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 324/673] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:09 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:10.137577 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6f089447-f83d-43d7-8802-000c1f870b9d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:10.138059 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-6f089447-f83d-43d7-8802-000c1f870b9d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:10.145385 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6f089447-f83d-43d7-8802-000c1f870b9d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:10.145832 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6f089447-f83d-43d7-8802-000c1f870b9d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:10.146587 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6f089447-f83d-43d7-8802-000c1f870b9d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:10.147026 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6f089447-f83d-43d7-8802-000c1f870b9d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:10.269354 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-6f089447-f83d-43d7-8802-000c1f870b9d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] HTTP exception thrown: Cannot 'detach_volume' instance f4a2ac88-a177-4fc8-867b-eef87107e914 while it is in vm_state rescued Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6f089447-f83d-43d7-8802-000c1f870b9d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Request method failure captured: Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: DELETE /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments/6a36d455-6fe9-4d74-aec4-c833744606ea HTTP/1.1 Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqniiFW-3qlgNwVdz83mtCf1EP3mQusIS9oVM71fN31IAhMvM3vimbmAv9v_7L8qh08N4M0qPQkSSLvw1vueWN6d7oLOTTpqqADq2uYSq6Uqr2TOGUFzua4lWlXwIlOH7P9cN5l04ADufU7_Vn7ZEXu2T4gOY4i-4Tgd3uEbqVYfn_fc Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 3f0f1114473045f899e99736ff9765df Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:32:10.270997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:32:10.272617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f0f1114473045f899e99736ff9765df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f0f1114473045f899e99736ff9765df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f0f1114473045f899e99736ff9765df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f0f1114473045f899e99736ff9765df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:32:10.272617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:32:10.272617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 3f0f1114473045f899e99736ff9765df Jun 16 00:32:10.272617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:32:10.272617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-ServerRescueNegativeTestJSON-1499675376-project Jun 16 00:32:10.272617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:32:10.272617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:32:10.272617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: 8a57c3f4e4d7479c9f301195cd9764cc Jun 16 00:32:10.272617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499675376-project Jun 16 00:32:10.272617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:32:10.272617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Cannot 'detach_volume' instance f4a2ac88-a177-4fc8-867b-eef87107e914 while it is in vm_state rescued Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'server_id': 'f4a2ac88-a177-4fc8-867b-eef87107e914', 'id': '6a36d455-6fe9-4d74-aec4-c833744606ea'} Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4a2ac88-a177-4fc8-867b-eef87107e914 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:32:10.273463 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f4a2ac88-a177-4fc8-867b-eef87107e914 while it is in vm_state rescued Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f4a2ac88-a177-4fc8-867b-eef87107e914 while it is in vm_state rescued Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:32:10.275013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6f089447-f83d-43d7-8802-000c1f870b9d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Returning 409 to user: Cannot 'detach_volume' instance f4a2ac88-a177-4fc8-867b-eef87107e914 while it is in vm_state rescued {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:32:10.276279 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-6f089447-f83d-43d7-8802-000c1f870b9d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments/6a36d455-6fe9-4d74-aec4-c833744606ea" status: 409 len: 152 microversion: 2.1 time: 0.138748 Jun 16 00:32:10.276279 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 350/674] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 16 00:32:10 2022] DELETE /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments/6a36d455-6fe9-4d74-aec4-c833744606ea => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 00:32:10.281418 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c8dcbb2b-105d-4f6b-a4f2-1e8cb279d2a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:10.281955 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c8dcbb2b-105d-4f6b-a4f2-1e8cb279d2a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:10.287966 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c8dcbb2b-105d-4f6b-a4f2-1e8cb279d2a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:10.288416 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c8dcbb2b-105d-4f6b-a4f2-1e8cb279d2a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:10.289178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c8dcbb2b-105d-4f6b-a4f2-1e8cb279d2a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:10.289615 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c8dcbb2b-105d-4f6b-a4f2-1e8cb279d2a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:10.354296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c8dcbb2b-105d-4f6b-a4f2-1e8cb279d2a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "POST /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/action" status: 202 len: 0 microversion: 2.1 time: 0.076565 Jun 16 00:32:10.355271 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 325/675] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:32:10 2022] POST /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:32:10.364192 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5af87a63-e429-4bd3-bc23-14003edfcded tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:10.364899 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5af87a63-e429-4bd3-bc23-14003edfcded tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:10.372396 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5af87a63-e429-4bd3-bc23-14003edfcded tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:10.373000 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5af87a63-e429-4bd3-bc23-14003edfcded tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:10.373772 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5af87a63-e429-4bd3-bc23-14003edfcded tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:10.375418 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5af87a63-e429-4bd3-bc23-14003edfcded tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:10.503355 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5af87a63-e429-4bd3-bc23-14003edfcded tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:10.511517 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5af87a63-e429-4bd3-bc23-14003edfcded tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1725 microversion: 2.1 time: 0.151173 Jun 16 00:32:10.512117 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 351/676] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:10 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:32:11.530016 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b3fa0a62-7ba5-4ac8-89da-4b4b54909d83 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:11.530817 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b3fa0a62-7ba5-4ac8-89da-4b4b54909d83 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:11.537652 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b3fa0a62-7ba5-4ac8-89da-4b4b54909d83 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:11.538121 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b3fa0a62-7ba5-4ac8-89da-4b4b54909d83 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:11.538874 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b3fa0a62-7ba5-4ac8-89da-4b4b54909d83 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:11.539311 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b3fa0a62-7ba5-4ac8-89da-4b4b54909d83 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:11.664864 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b3fa0a62-7ba5-4ac8-89da-4b4b54909d83 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:11.672725 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b3fa0a62-7ba5-4ac8-89da-4b4b54909d83 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1725 microversion: 2.1 time: 0.146914 Jun 16 00:32:11.673282 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 326/677] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:11 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:12.690245 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f4c43398-373d-4cab-93a7-748b606fa3cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:12.690786 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f4c43398-373d-4cab-93a7-748b606fa3cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:12.697116 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4c43398-373d-4cab-93a7-748b606fa3cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:12.697602 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4c43398-373d-4cab-93a7-748b606fa3cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:12.698410 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4c43398-373d-4cab-93a7-748b606fa3cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:12.698852 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4c43398-373d-4cab-93a7-748b606fa3cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:12.828123 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f4c43398-373d-4cab-93a7-748b606fa3cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:12.836014 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f4c43398-373d-4cab-93a7-748b606fa3cc tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1725 microversion: 2.1 time: 0.149885 Jun 16 00:32:12.836605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 352/678] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:12 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:13.852887 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-91e0821c-9db6-498d-a941-c19997fe8e01 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:13.853498 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-91e0821c-9db6-498d-a941-c19997fe8e01 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:13.860625 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-91e0821c-9db6-498d-a941-c19997fe8e01 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:13.861075 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-91e0821c-9db6-498d-a941-c19997fe8e01 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:13.861839 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-91e0821c-9db6-498d-a941-c19997fe8e01 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:13.862276 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-91e0821c-9db6-498d-a941-c19997fe8e01 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:13.986758 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-91e0821c-9db6-498d-a941-c19997fe8e01 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:13.994657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-91e0821c-9db6-498d-a941-c19997fe8e01 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1725 microversion: 2.1 time: 0.145601 Jun 16 00:32:13.995223 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 327/679] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:13 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:15.011822 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4df7c943-641c-4611-b35d-b255e537f2ef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:15.012433 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4df7c943-641c-4611-b35d-b255e537f2ef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:15.018936 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4df7c943-641c-4611-b35d-b255e537f2ef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:15.019667 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4df7c943-641c-4611-b35d-b255e537f2ef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:15.020437 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4df7c943-641c-4611-b35d-b255e537f2ef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:15.020875 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4df7c943-641c-4611-b35d-b255e537f2ef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:15.150385 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4df7c943-641c-4611-b35d-b255e537f2ef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:15.158978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4df7c943-641c-4611-b35d-b255e537f2ef tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1731 microversion: 2.1 time: 0.150999 Jun 16 00:32:15.159552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 353/680] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:15 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:15.176038 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2d45a7d2-159e-423f-9d16-7773952bf889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:15.176605 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2d45a7d2-159e-423f-9d16-7773952bf889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:15.182826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2d45a7d2-159e-423f-9d16-7773952bf889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:15.183268 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2d45a7d2-159e-423f-9d16-7773952bf889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:15.184066 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2d45a7d2-159e-423f-9d16-7773952bf889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:15.184502 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2d45a7d2-159e-423f-9d16-7773952bf889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:15.260875 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2d45a7d2-159e-423f-9d16-7773952bf889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089269 Jun 16 00:32:15.261649 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 328/681] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 16 00:32:15 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:16.450108 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-7b91b0ee-4a9a-4f80-8e0a-5a49898643fd req-810a13bf-1d82-43c3-bfea-3b8a640d6e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a2ac88-a177-4fc8-867b-eef87107e914", "tag": "0e361567-aa2b-46e9-a10e-0d979e26890a"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:16.458872 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-7b91b0ee-4a9a-4f80-8e0a-5a49898643fd req-810a13bf-1d82-43c3-bfea-3b8a640d6e52 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:16.459319 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-7b91b0ee-4a9a-4f80-8e0a-5a49898643fd req-810a13bf-1d82-43c3-bfea-3b8a640d6e52 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:16.470557 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-7b91b0ee-4a9a-4f80-8e0a-5a49898643fd req-810a13bf-1d82-43c3-bfea-3b8a640d6e52 service nova] Creating event network-changed:0e361567-aa2b-46e9-a10e-0d979e26890a for instance f4a2ac88-a177-4fc8-867b-eef87107e914 on hv-cinder-84327 Jun 16 00:32:16.475559 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-7b91b0ee-4a9a-4f80-8e0a-5a49898643fd req-810a13bf-1d82-43c3-bfea-3b8a640d6e52 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099166 Jun 16 00:32:16.476177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 354/682] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:18.490949 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-6847328b-09de-4b51-9792-b5f751d93ea8 req-3ac23372-ed1d-41c0-aa95-4e1fcca23cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a2ac88-a177-4fc8-867b-eef87107e914", "tag": "0e361567-aa2b-46e9-a10e-0d979e26890a"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:18.499115 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-6847328b-09de-4b51-9792-b5f751d93ea8 req-3ac23372-ed1d-41c0-aa95-4e1fcca23cda service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:18.500164 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-6847328b-09de-4b51-9792-b5f751d93ea8 req-3ac23372-ed1d-41c0-aa95-4e1fcca23cda service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:18.510907 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-6847328b-09de-4b51-9792-b5f751d93ea8 req-3ac23372-ed1d-41c0-aa95-4e1fcca23cda service nova] Creating event network-changed:0e361567-aa2b-46e9-a10e-0d979e26890a for instance f4a2ac88-a177-4fc8-867b-eef87107e914 on hv-cinder-84327 Jun 16 00:32:18.515883 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-6847328b-09de-4b51-9792-b5f751d93ea8 req-3ac23372-ed1d-41c0-aa95-4e1fcca23cda service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029166 Jun 16 00:32:18.516439 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 329/683] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:52.398008 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:32:52.398597 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Thu Jun 16 00:32:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:32:52.802845 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=13 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:52.803574 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=40 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:52.857173 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-48daafc5-cffe-4874-b6a7-6cd781bc538e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:52.857758 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-48daafc5-cffe-4874-b6a7-6cd781bc538e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:52.863932 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-48daafc5-cffe-4874-b6a7-6cd781bc538e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.864377 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-48daafc5-cffe-4874-b6a7-6cd781bc538e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.865134 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-48daafc5-cffe-4874-b6a7-6cd781bc538e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.865569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-48daafc5-cffe-4874-b6a7-6cd781bc538e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.887428 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-48daafc5-cffe-4874-b6a7-6cd781bc538e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687/ips" status: 200 len: 149 microversion: 2.1 time: 0.086328 Jun 16 00:32:52.887986 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 355/684] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 16 00:32:52 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687/ips => generated 149 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:52.897265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=17 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:52.898030 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:52.903019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-20f335d5-ca9c-42a5-8c73-4400d3f3de5b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf64b0d3-0268-4c29-83ca-c92ae690805d"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:52.904207 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-20f335d5-ca9c-42a5-8c73-4400d3f3de5b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:52.913012 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-20f335d5-ca9c-42a5-8c73-4400d3f3de5b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.913454 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-20f335d5-ca9c-42a5-8c73-4400d3f3de5b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.914213 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-20f335d5-ca9c-42a5-8c73-4400d3f3de5b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:52.914641 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-20f335d5-ca9c-42a5-8c73-4400d3f3de5b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:52.992861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-20f335d5-ca9c-42a5-8c73-4400d3f3de5b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Invalid volume: volume cf64b0d3-0268-4c29-83ca-c92ae690805d is already attached to instances: 0940a4aa-71c4-4a96-8106-40dd8b012547 Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-20f335d5-ca9c-42a5-8c73-4400d3f3de5b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: POST /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687/os-volume_attachments HTTP/1.1 Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 74 Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:32:52.994544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:32:52.996296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:32:52.996296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:32:52.996296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:32:52.996296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:32:52.996296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:32:52.996296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:32:52.996296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:32:52.996296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:32:52.996296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:32:52.996296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Jun 16 00:32:52.996296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {"volumeAttachment": {"volumeId": "cf64b0d3-0268-4c29-83ca-c92ae690805d"}} Jun 16 00:32:52.996296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Invalid volume: volume cf64b0d3-0268-4c29-83ca-c92ae690805d is already attached to instances: 0940a4aa-71c4-4a96-8106-40dd8b012547 Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'server_id': '15d275db-db63-4899-b5f6-ed3852580687', 'body': {'volumeAttachment': {'volumeId': 'cf64b0d3-0268-4c29-83ca-c92ae690805d'}}} Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cf64b0d3-0268-4c29-83ca-c92ae690805d is already attached to instances: 0940a4aa-71c4-4a96-8106-40dd8b012547 Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:32:52.997259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cf64b0d3-0268-4c29-83ca-c92ae690805d is already attached to instances: 0940a4aa-71c4-4a96-8106-40dd8b012547 Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:52.998544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:52.999826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:52.999826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:32:52.999826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:32:52.999826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cf64b0d3-0268-4c29-83ca-c92ae690805d is already attached to instances: 0940a4aa-71c4-4a96-8106-40dd8b012547 Jun 16 00:32:52.999826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:32:52.999826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-20f335d5-ca9c-42a5-8c73-4400d3f3de5b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 400 to user: Invalid volume: volume cf64b0d3-0268-4c29-83ca-c92ae690805d is already attached to instances: 0940a4aa-71c4-4a96-8106-40dd8b012547 {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:32:52.999826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-20f335d5-ca9c-42a5-8c73-4400d3f3de5b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100534 Jun 16 00:32:52.999826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 330/685] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:32:52 2022] POST /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:32:53.005209 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-64473d46-ecd8-47a1-8ed1-68959c0f971e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:53.005698 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-64473d46-ecd8-47a1-8ed1-68959c0f971e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:53.011552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-64473d46-ecd8-47a1-8ed1-68959c0f971e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:53.012030 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-64473d46-ecd8-47a1-8ed1-68959c0f971e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:53.012775 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-64473d46-ecd8-47a1-8ed1-68959c0f971e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:53.013205 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-64473d46-ecd8-47a1-8ed1-68959c0f971e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:53.039756 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-64473d46-ecd8-47a1-8ed1-68959c0f971e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Going to try to terminate instance {{(pid=129466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:32:53.111199 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-64473d46-ecd8-47a1-8ed1-68959c0f971e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 204 len: 0 microversion: 2.1 time: 0.109860 Jun 16 00:32:53.111727 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 356/686] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:32:52 2022] DELETE /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:32:53.120014 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-589544d5-6834-43f0-9bba-4dfe45f38306 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:53.120612 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-589544d5-6834-43f0-9bba-4dfe45f38306 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:53.129766 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-589544d5-6834-43f0-9bba-4dfe45f38306 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:53.130211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-589544d5-6834-43f0-9bba-4dfe45f38306 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:53.130966 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-589544d5-6834-43f0-9bba-4dfe45f38306 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:53.131399 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-589544d5-6834-43f0-9bba-4dfe45f38306 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:53.256399 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-589544d5-6834-43f0-9bba-4dfe45f38306 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:53.263731 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-589544d5-6834-43f0-9bba-4dfe45f38306 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1680 microversion: 2.1 time: 0.147472 Jun 16 00:32:53.264284 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 331/687] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:53 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:54.283166 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a1e3b4c9-fba3-405c-95a1-2f2e16f2d267 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:54.284435 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a1e3b4c9-fba3-405c-95a1-2f2e16f2d267 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:54.290824 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a1e3b4c9-fba3-405c-95a1-2f2e16f2d267 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.291278 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a1e3b4c9-fba3-405c-95a1-2f2e16f2d267 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:54.292062 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a1e3b4c9-fba3-405c-95a1-2f2e16f2d267 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:54.292493 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a1e3b4c9-fba3-405c-95a1-2f2e16f2d267 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:54.421299 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a1e3b4c9-fba3-405c-95a1-2f2e16f2d267 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:54.429529 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a1e3b4c9-fba3-405c-95a1-2f2e16f2d267 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1680 microversion: 2.1 time: 0.150533 Jun 16 00:32:54.430084 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 357/688] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:54 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:55.446915 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e1618a7d-fb86-4ecd-9e64-8dbb2e70d345 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:55.447437 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e1618a7d-fb86-4ecd-9e64-8dbb2e70d345 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:55.454045 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e1618a7d-fb86-4ecd-9e64-8dbb2e70d345 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:55.454486 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e1618a7d-fb86-4ecd-9e64-8dbb2e70d345 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:55.455849 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e1618a7d-fb86-4ecd-9e64-8dbb2e70d345 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:55.456283 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e1618a7d-fb86-4ecd-9e64-8dbb2e70d345 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:55.584124 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e1618a7d-fb86-4ecd-9e64-8dbb2e70d345 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:32:55.591809 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e1618a7d-fb86-4ecd-9e64-8dbb2e70d345 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 200 len: 1680 microversion: 2.1 time: 0.148783 Jun 16 00:32:55.592414 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 332/689] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:55 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:32:55.989284 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-ee21e742-adf9-4b0d-b76e-69c676355e99 req-801c888a-4c04-4d72-8a1e-a2f6e196be16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d275db-db63-4899-b5f6-ed3852580687", "name": "network-vif-deleted", "tag": "c47ab338-4dce-4e11-84eb-63e0e2bccd8d"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:32:55.998107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-ee21e742-adf9-4b0d-b76e-69c676355e99 req-801c888a-4c04-4d72-8a1e-a2f6e196be16 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:55.998556 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-ee21e742-adf9-4b0d-b76e-69c676355e99 req-801c888a-4c04-4d72-8a1e-a2f6e196be16 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:56.010830 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-ee21e742-adf9-4b0d-b76e-69c676355e99 req-801c888a-4c04-4d72-8a1e-a2f6e196be16 service nova] Creating event network-vif-deleted:c47ab338-4dce-4e11-84eb-63e0e2bccd8d for instance 15d275db-db63-4899-b5f6-ed3852580687 on hv-cinder-84327 Jun 16 00:32:56.016630 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-ee21e742-adf9-4b0d-b76e-69c676355e99 req-801c888a-4c04-4d72-8a1e-a2f6e196be16 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091982 Jun 16 00:32:56.017434 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 358/690] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:56.609065 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c6d9fcde-0c11-4238-a5e7-7d4424964b3c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:56.609677 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c6d9fcde-0c11-4238-a5e7-7d4424964b3c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:56.619454 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c6d9fcde-0c11-4238-a5e7-7d4424964b3c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:56.619796 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c6d9fcde-0c11-4238-a5e7-7d4424964b3c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:56.620600 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c6d9fcde-0c11-4238-a5e7-7d4424964b3c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:56.621032 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c6d9fcde-0c11-4238-a5e7-7d4424964b3c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:56.635777 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-c6d9fcde-0c11-4238-a5e7-7d4424964b3c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c6d9fcde-0c11-4238-a5e7-7d4424964b3c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 HTTP/1.1 Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:32:56.637316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:32:56.638688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:32:56.638688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:32:56.638688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:32:56.638688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:32:56.638688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:32:56.638688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:32:56.638688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:32:56.638688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:32:56.638688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:32:56.638688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:32:56.638688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:32:56.638688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '15d275db-db63-4899-b5f6-ed3852580687'} Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:32:56.639674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:32:56.641051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:32:56.642142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c6d9fcde-0c11-4238-a5e7-7d4424964b3c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 404 to user: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:32:56.642142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c6d9fcde-0c11-4238-a5e7-7d4424964b3c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 404 len: 111 microversion: 2.1 time: 0.033571 Jun 16 00:32:56.642142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 333/691] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:56 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:32:56.648681 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d996c4db-3ffa-4244-a243-a2659d55c49a tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '.version_select at 0x7f9573c8df70>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:56.673251 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d996c4db-3ffa-4244-a243-a2659d55c49a tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-619866005" status: 202 len: 0 microversion: 2.1 time: 0.028986 Jun 16 00:32:56.675149 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 359/692] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jun 16 00:32:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-619866005 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:32:57.349635 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e3cfb4fb-d034-4f74-8877-74faa4accdbb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:57.350132 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e3cfb4fb-d034-4f74-8877-74faa4accdbb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:57.356098 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e3cfb4fb-d034-4f74-8877-74faa4accdbb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:57.356550 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e3cfb4fb-d034-4f74-8877-74faa4accdbb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:57.357315 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e3cfb4fb-d034-4f74-8877-74faa4accdbb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:57.357752 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e3cfb4fb-d034-4f74-8877-74faa4accdbb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:57.480002 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-e3cfb4fb-d034-4f74-8877-74faa4accdbb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lazy-loading 'services' on Instance uuid 0940a4aa-71c4-4a96-8106-40dd8b012547 {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:32:57.604319 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e3cfb4fb-d034-4f74-8877-74faa4accdbb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/os-volume_attachments/cf64b0d3-0268-4c29-83ca-c92ae690805d" status: 202 len: 0 microversion: 2.1 time: 0.258041 Jun 16 00:32:57.605118 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 334/693] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 16 00:32:57 2022] DELETE /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/os-volume_attachments/cf64b0d3-0268-4c29-83ca-c92ae690805d => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:32:57.614214 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c6fa031b-9599-4f6c-b18e-028ae98d7817 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:57.615285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c6fa031b-9599-4f6c-b18e-028ae98d7817 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:57.623559 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c6fa031b-9599-4f6c-b18e-028ae98d7817 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:57.624290 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c6fa031b-9599-4f6c-b18e-028ae98d7817 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:57.625331 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c6fa031b-9599-4f6c-b18e-028ae98d7817 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:57.627520 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c6fa031b-9599-4f6c-b18e-028ae98d7817 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:57.662273 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c6fa031b-9599-4f6c-b18e-028ae98d7817 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052219 Jun 16 00:32:57.663116 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 360/694] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:32:57 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:58.675306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9d4406e8-5ec7-4dcc-90c6-ef1f31dc230c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:58.676332 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9d4406e8-5ec7-4dcc-90c6-ef1f31dc230c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:58.686462 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d4406e8-5ec7-4dcc-90c6-ef1f31dc230c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:58.686911 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d4406e8-5ec7-4dcc-90c6-ef1f31dc230c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:58.687704 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d4406e8-5ec7-4dcc-90c6-ef1f31dc230c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:58.688139 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d4406e8-5ec7-4dcc-90c6-ef1f31dc230c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:58.716066 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9d4406e8-5ec7-4dcc-90c6-ef1f31dc230c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045145 Jun 16 00:32:58.716607 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 335/695] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:32:58 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:59.726920 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4edf0248-9d5f-4242-b804-a3ef1fb07cf9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:59.727865 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4edf0248-9d5f-4242-b804-a3ef1fb07cf9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:59.734309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4edf0248-9d5f-4242-b804-a3ef1fb07cf9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.734755 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4edf0248-9d5f-4242-b804-a3ef1fb07cf9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.735513 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4edf0248-9d5f-4242-b804-a3ef1fb07cf9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.735978 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4edf0248-9d5f-4242-b804-a3ef1fb07cf9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.763851 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4edf0248-9d5f-4242-b804-a3ef1fb07cf9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040807 Jun 16 00:32:59.764385 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 361/696] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:32:59 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:32:59.822558 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bb3da132-e507-45dc-bfce-f52eef3b2109 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:59.823045 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bb3da132-e507-45dc-bfce-f52eef3b2109 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:59.829495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb3da132-e507-45dc-bfce-f52eef3b2109 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.829967 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb3da132-e507-45dc-bfce-f52eef3b2109 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.831301 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb3da132-e507-45dc-bfce-f52eef3b2109 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.831761 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb3da132-e507-45dc-bfce-f52eef3b2109 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.857177 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bb3da132-e507-45dc-bfce-f52eef3b2109 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Going to try to terminate instance {{(pid=129465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:32:59.933636 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bb3da132-e507-45dc-bfce-f52eef3b2109 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 204 len: 0 microversion: 2.1 time: 0.114352 Jun 16 00:32:59.934457 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 336/697] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:32:59 2022] DELETE /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:32:59.943283 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-efaad95c-b136-43e2-8b4e-ac29a6c121ce tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:59.943918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-efaad95c-b136-43e2-8b4e-ac29a6c121ce tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:32:59.949789 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-efaad95c-b136-43e2-8b4e-ac29a6c121ce tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.950235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-efaad95c-b136-43e2-8b4e-ac29a6c121ce tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:59.950993 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-efaad95c-b136-43e2-8b4e-ac29a6c121ce tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:59.951430 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-efaad95c-b136-43e2-8b4e-ac29a6c121ce tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:00.077982 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-efaad95c-b136-43e2-8b4e-ac29a6c121ce tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:00.085835 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-efaad95c-b136-43e2-8b4e-ac29a6c121ce tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1679 microversion: 2.1 time: 0.146450 Jun 16 00:33:00.086388 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 362/698] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:32:59 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:01.103448 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9bc423bb-5730-40b0-b050-783c67f26624 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:01.104079 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9bc423bb-5730-40b0-b050-783c67f26624 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:01.110427 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9bc423bb-5730-40b0-b050-783c67f26624 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:01.110870 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9bc423bb-5730-40b0-b050-783c67f26624 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:01.112206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9bc423bb-5730-40b0-b050-783c67f26624 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:01.112632 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9bc423bb-5730-40b0-b050-783c67f26624 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:01.239907 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9bc423bb-5730-40b0-b050-783c67f26624 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:01.248109 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9bc423bb-5730-40b0-b050-783c67f26624 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1679 microversion: 2.1 time: 0.148859 Jun 16 00:33:01.248674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 337/699] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:01 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:02.178083 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-673b1b82-89a5-460c-b97e-0ad6ac21ad1d req-7125474c-a443-46c0-9566-bb45f7870d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0940a4aa-71c4-4a96-8106-40dd8b012547", "name": "network-vif-deleted", "tag": "24633b83-4728-4103-8fab-2eb65a801405"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:02.187169 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-673b1b82-89a5-460c-b97e-0ad6ac21ad1d req-7125474c-a443-46c0-9566-bb45f7870d6c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:02.187642 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-673b1b82-89a5-460c-b97e-0ad6ac21ad1d req-7125474c-a443-46c0-9566-bb45f7870d6c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:02.199523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-673b1b82-89a5-460c-b97e-0ad6ac21ad1d req-7125474c-a443-46c0-9566-bb45f7870d6c service nova] Creating event network-vif-deleted:24633b83-4728-4103-8fab-2eb65a801405 for instance 0940a4aa-71c4-4a96-8106-40dd8b012547 on hv-cinder-84327 Jun 16 00:33:02.205057 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-673b1b82-89a5-460c-b97e-0ad6ac21ad1d req-7125474c-a443-46c0-9566-bb45f7870d6c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033923 Jun 16 00:33:02.206275 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 363/700] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:02.265148 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3c8726e0-93da-4ca7-bcdf-49a0ca244729 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:02.265660 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3c8726e0-93da-4ca7-bcdf-49a0ca244729 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:02.272976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c8726e0-93da-4ca7-bcdf-49a0ca244729 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:02.273414 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c8726e0-93da-4ca7-bcdf-49a0ca244729 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:02.274452 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c8726e0-93da-4ca7-bcdf-49a0ca244729 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:02.275143 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c8726e0-93da-4ca7-bcdf-49a0ca244729 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:02.307734 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c8726e0-93da-4ca7-bcdf-49a0ca244729 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:02.308560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3c8726e0-93da-4ca7-bcdf-49a0ca244729 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:02.309241 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-3c8726e0-93da-4ca7-bcdf-49a0ca244729 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lazy-loading 'fault' on Instance uuid 0940a4aa-71c4-4a96-8106-40dd8b012547 {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:33:02.356037 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3c8726e0-93da-4ca7-bcdf-49a0ca244729 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:02.363640 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3c8726e0-93da-4ca7-bcdf-49a0ca244729 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 200 len: 1331 microversion: 2.1 time: 0.102324 Jun 16 00:33:02.364278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 338/701] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:02 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:03.382379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-201269fc-0c98-4fa8-a907-dd7b9e130673 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:03.383067 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-201269fc-0c98-4fa8-a907-dd7b9e130673 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:03.389291 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-201269fc-0c98-4fa8-a907-dd7b9e130673 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:03.389732 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-201269fc-0c98-4fa8-a907-dd7b9e130673 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:03.390484 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-201269fc-0c98-4fa8-a907-dd7b9e130673 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:03.390913 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-201269fc-0c98-4fa8-a907-dd7b9e130673 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:03.404124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-201269fc-0c98-4fa8-a907-dd7b9e130673 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-201269fc-0c98-4fa8-a907-dd7b9e130673 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 HTTP/1.1 Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:33:03.405720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:33:03.407237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:33:03.407237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:33:03.407237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:33:03.407237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:33:03.407237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:33:03.407237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:33:03.407237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:33:03.407237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:33:03.407237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:33:03.407237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:33:03.407237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:33:03.407237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '0940a4aa-71c4-4a96-8106-40dd8b012547'} Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:33:03.408717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:33:03.410168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:03.411457 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-201269fc-0c98-4fa8-a907-dd7b9e130673 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 404 to user: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:33:03.411457 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-201269fc-0c98-4fa8-a907-dd7b9e130673 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 404 len: 111 microversion: 2.1 time: 0.030027 Jun 16 00:33:03.411457 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 364/702] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:03 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:33:03.416714 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1a6c67f7-27ff-4bb6-8a3b-7aefd36158d6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '.version_select at 0x7f9580439160>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:03.438072 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1a6c67f7-27ff-4bb6-8a3b-7aefd36158d6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-268979143" status: 202 len: 0 microversion: 2.1 time: 0.025089 Jun 16 00:33:03.438649 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 339/703] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jun 16 00:33:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-268979143 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:33:04.068926 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e83154cd-10d8-47d3-af37-b237b71d6b51 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: .version_select at 0x7f9573cbdf70>, body: {"keypair": {"name": "tempest-keypair-757627005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2eZWsoy5AYw52PtRrWPZTtbP7HLd6az4qM8/n/i8VeSyv5p4lK6ZYz9sZjRc2vrf7dtcluGJxM7yyWd82h6iNRLZDp8+/ndc19Uxtiduz9lobrPYyGWBZVB9nrcUzxAA=="}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:04.083508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-e83154cd-10d8-47d3-af37-b237b71d6b51 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for project def39ced63b64e3aa65c9542ae512e7e. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:33:04.087298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-e83154cd-10d8-47d3-af37-b237b71d6b51 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for user f0c5a5705f34440abce48190674a76d5 and project def39ced63b64e3aa65c9542ae512e7e. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:33:04.109255 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e83154cd-10d8-47d3-af37-b237b71d6b51 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044222 Jun 16 00:33:04.109839 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 365/704] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 16 00:33:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:04.304750 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-16b8aa31-8245-4d70-b8da-fda55d3f9339 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:04.305356 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-16b8aa31-8245-4d70-b8da-fda55d3f9339 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:04.311299 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-16b8aa31-8245-4d70-b8da-fda55d3f9339 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:04.311783 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-16b8aa31-8245-4d70-b8da-fda55d3f9339 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:04.312552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-16b8aa31-8245-4d70-b8da-fda55d3f9339 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:04.312987 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-16b8aa31-8245-4d70-b8da-fda55d3f9339 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:04.343712 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-16b8aa31-8245-4d70-b8da-fda55d3f9339 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/os-volume_attachments/c12fb86f-e13e-4edc-9d3e-811f4af1c55b" status: 200 len: 194 microversion: 2.20 time: 0.042793 Jun 16 00:33:04.344242 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 340/705] 10.222.0.44 () {60 vars in 1453 bytes} [Thu Jun 16 00:33:04 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/os-volume_attachments/c12fb86f-e13e-4edc-9d3e-811f4af1c55b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:33:04.414868 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-bd93ad2b-1487-4b2a-8dd6-ce19f346ee69 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:04.415397 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-bd93ad2b-1487-4b2a-8dd6-ce19f346ee69 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:04.425243 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bd93ad2b-1487-4b2a-8dd6-ce19f346ee69 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:04.425695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bd93ad2b-1487-4b2a-8dd6-ce19f346ee69 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:04.426470 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bd93ad2b-1487-4b2a-8dd6-ce19f346ee69 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:04.426906 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bd93ad2b-1487-4b2a-8dd6-ce19f346ee69 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:04.511220 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.objects.instance [None req-bd93ad2b-1487-4b2a-8dd6-ce19f346ee69 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lazy-loading 'services' on Instance uuid 7b84afb6-466c-477a-9339-b4a0ecef36be {{(pid=129466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:33:04.625697 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-bd93ad2b-1487-4b2a-8dd6-ce19f346ee69 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/os-volume_attachments/c12fb86f-e13e-4edc-9d3e-811f4af1c55b" status: 202 len: 0 microversion: 2.20 time: 0.214664 Jun 16 00:33:04.626490 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 366/706] 10.222.0.44 () {60 vars in 1456 bytes} [Thu Jun 16 00:33:04 2022] DELETE /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/os-volume_attachments/c12fb86f-e13e-4edc-9d3e-811f4af1c55b => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:33:04.636487 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-19a35bed-7701-4bcd-b867-260f32015217 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:04.637414 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-19a35bed-7701-4bcd-b867-260f32015217 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:04.644928 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-19a35bed-7701-4bcd-b867-260f32015217 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:04.645480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-19a35bed-7701-4bcd-b867-260f32015217 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:04.646538 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-19a35bed-7701-4bcd-b867-260f32015217 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:04.647031 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-19a35bed-7701-4bcd-b867-260f32015217 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:04.686426 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-19a35bed-7701-4bcd-b867-260f32015217 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054217 Jun 16 00:33:04.687058 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 341/707] 10.222.0.44 () {60 vars in 1342 bytes} [Thu Jun 16 00:33:04 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:33:05.355222 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2056514498", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a813215-bb6e-4258-9089-1e234ad6c22c"}], "security_groups": [{"name": "tempest-securitygroup--1332993988"}], "key_name": "tempest-keypair-757627005", "user_data": "}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:05.454503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.network.neutron [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] validate_networks() for [('0a813215-bb6e-4258-9089-1e234ad6c22c', None, None, None, None, None)] {{(pid=129466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:33:05.698400 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6a4c4a5e-16b7-409d-8b2a-5231ae6abb1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:05.699315 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6a4c4a5e-16b7-409d-8b2a-5231ae6abb1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:05.705557 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6a4c4a5e-16b7-409d-8b2a-5231ae6abb1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:05.706011 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6a4c4a5e-16b7-409d-8b2a-5231ae6abb1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:05.706783 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6a4c4a5e-16b7-409d-8b2a-5231ae6abb1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:05.707219 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6a4c4a5e-16b7-409d-8b2a-5231ae6abb1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:05.735369 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6a4c4a5e-16b7-409d-8b2a-5231ae6abb1b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040925 Jun 16 00:33:05.735968 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 342/708] 10.222.0.44 () {60 vars in 1342 bytes} [Thu Jun 16 00:33:05 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:05.794769 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-48eac361-4908-4f1f-ada9-890241311588 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:05.795641 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-48eac361-4908-4f1f-ada9-890241311588 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:05.803516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-48eac361-4908-4f1f-ada9-890241311588 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:05.803516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-48eac361-4908-4f1f-ada9-890241311588 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:05.804247 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-48eac361-4908-4f1f-ada9-890241311588 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:05.804682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-48eac361-4908-4f1f-ada9-890241311588 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:05.831491 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-48eac361-4908-4f1f-ada9-890241311588 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Going to try to terminate instance {{(pid=129465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:33:05.880162 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Flavor limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:33:05.880586 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Image limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:33:05.881077 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Flavor pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:33:05.881477 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Image pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:33:05.881885 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:33:05.881997 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:05.892140 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:05.892583 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:05.893371 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:05.893809 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:05.911263 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-48eac361-4908-4f1f-ada9-890241311588 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 204 len: 0 microversion: 2.20 time: 0.120263 Jun 16 00:33:05.912148 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 343/709] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jun 16 00:33:05 2022] DELETE /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 00:33:05.915237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for project def39ced63b64e3aa65c9542ae512e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:33:05.919131 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for user f0c5a5705f34440abce48190674a76d5 and project def39ced63b64e3aa65c9542ae512e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:33:05.920677 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-655561ba-09e3-45da-b030-9aa4c5f25b86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:05.921384 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-655561ba-09e3-45da-b030-9aa4c5f25b86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:05.927369 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-655561ba-09e3-45da-b030-9aa4c5f25b86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:05.927863 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-655561ba-09e3-45da-b030-9aa4c5f25b86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:05.928665 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-655561ba-09e3-45da-b030-9aa4c5f25b86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:05.929104 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-655561ba-09e3-45da-b030-9aa4c5f25b86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:05.930256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Going to run 1 instances... {{(pid=129466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:33:05.932623 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:33:05.982015 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8535ac42-0185-4f29-9a4c-f830d94f6a5d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.631315 Jun 16 00:33:05.982642 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 367/710] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:33:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:33:05.992888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9e218c08-5831-4245-b73c-4faf8c5201f7 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:05.993612 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9e218c08-5831-4245-b73c-4faf8c5201f7 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:06.057906 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9e218c08-5831-4245-b73c-4faf8c5201f7 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:06.065970 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9e218c08-5831-4245-b73c-4faf8c5201f7 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1241 microversion: 2.1 time: 0.077201 Jun 16 00:33:06.074334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 368/711] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:05 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:06.104703 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-655561ba-09e3-45da-b030-9aa4c5f25b86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:06.113219 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-655561ba-09e3-45da-b030-9aa4c5f25b86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:06.115196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-655561ba-09e3-45da-b030-9aa4c5f25b86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:06.116493 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-655561ba-09e3-45da-b030-9aa4c5f25b86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.199916 Jun 16 00:33:06.117040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 344/712] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:05 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:07.082944 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-068ccbfd-5dec-4fac-8161-d7e7d9ca8854 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:07.083681 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-068ccbfd-5dec-4fac-8161-d7e7d9ca8854 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:07.090470 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-068ccbfd-5dec-4fac-8161-d7e7d9ca8854 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:07.090912 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-068ccbfd-5dec-4fac-8161-d7e7d9ca8854 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:07.091693 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-068ccbfd-5dec-4fac-8161-d7e7d9ca8854 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:07.092126 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-068ccbfd-5dec-4fac-8161-d7e7d9ca8854 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:07.135151 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-124c6a79-8bca-4497-87f5-928ef3220b89 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:07.135773 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-124c6a79-8bca-4497-87f5-928ef3220b89 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:07.142506 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-124c6a79-8bca-4497-87f5-928ef3220b89 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:07.142946 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-124c6a79-8bca-4497-87f5-928ef3220b89 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:07.143766 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-124c6a79-8bca-4497-87f5-928ef3220b89 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:07.144183 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-124c6a79-8bca-4497-87f5-928ef3220b89 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:07.156841 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-068ccbfd-5dec-4fac-8161-d7e7d9ca8854 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:07.164689 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-068ccbfd-5dec-4fac-8161-d7e7d9ca8854 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1245 microversion: 2.1 time: 0.085763 Jun 16 00:33:07.165242 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 369/713] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:07 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:07.275724 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-124c6a79-8bca-4497-87f5-928ef3220b89 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:07.284573 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-124c6a79-8bca-4497-87f5-928ef3220b89 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:07.286078 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-124c6a79-8bca-4497-87f5-928ef3220b89 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:07.287237 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-124c6a79-8bca-4497-87f5-928ef3220b89 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.155910 Jun 16 00:33:07.287828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 345/714] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:07 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:33:08.183194 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8c8f2747-c577-4cdc-a543-a57811f88965 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:08.183959 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8c8f2747-c577-4cdc-a543-a57811f88965 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:08.191731 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c8f2747-c577-4cdc-a543-a57811f88965 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:08.192182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c8f2747-c577-4cdc-a543-a57811f88965 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:08.193128 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c8f2747-c577-4cdc-a543-a57811f88965 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:08.193570 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c8f2747-c577-4cdc-a543-a57811f88965 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:08.261615 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8c8f2747-c577-4cdc-a543-a57811f88965 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:08.269916 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8c8f2747-c577-4cdc-a543-a57811f88965 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1311 microversion: 2.1 time: 0.091542 Jun 16 00:33:08.270488 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 370/715] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:08 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:08.305594 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a3babfcd-4f81-4520-9dc6-6a31c22770f3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:08.306202 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a3babfcd-4f81-4520-9dc6-6a31c22770f3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:08.312669 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a3babfcd-4f81-4520-9dc6-6a31c22770f3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:08.313116 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a3babfcd-4f81-4520-9dc6-6a31c22770f3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:08.313884 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a3babfcd-4f81-4520-9dc6-6a31c22770f3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:08.314865 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a3babfcd-4f81-4520-9dc6-6a31c22770f3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:08.444832 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a3babfcd-4f81-4520-9dc6-6a31c22770f3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:08.452968 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a3babfcd-4f81-4520-9dc6-6a31c22770f3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:08.454536 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a3babfcd-4f81-4520-9dc6-6a31c22770f3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:08.455847 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a3babfcd-4f81-4520-9dc6-6a31c22770f3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1723 microversion: 2.20 time: 0.154137 Jun 16 00:33:08.456495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 346/716] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:08 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:09.287305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a27d8be5-41a8-4080-b856-06c74180b52b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:09.288049 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a27d8be5-41a8-4080-b856-06c74180b52b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:09.295226 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a27d8be5-41a8-4080-b856-06c74180b52b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:09.295713 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a27d8be5-41a8-4080-b856-06c74180b52b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:09.296533 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a27d8be5-41a8-4080-b856-06c74180b52b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:09.296977 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a27d8be5-41a8-4080-b856-06c74180b52b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:09.368432 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a27d8be5-41a8-4080-b856-06c74180b52b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:09.376919 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a27d8be5-41a8-4080-b856-06c74180b52b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1299 microversion: 2.1 time: 0.093774 Jun 16 00:33:09.386696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 371/717] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:09 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:09.434938 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-8c265e4d-6426-4293-b313-34364c0db357 req-fa8a9542-dbc3-4f7c-aaa6-26eecfe23856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b84afb6-466c-477a-9339-b4a0ecef36be", "name": "network-vif-deleted", "tag": "f807a98a-f8e6-4868-ab21-4008a07a1ae4"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:09.475548 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-07092674-6db3-429f-b596-25f7ca04fe00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:09.476359 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-07092674-6db3-429f-b596-25f7ca04fe00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:09.490552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-8c265e4d-6426-4293-b313-34364c0db357 req-fa8a9542-dbc3-4f7c-aaa6-26eecfe23856 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:09.491163 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-8c265e4d-6426-4293-b313-34364c0db357 req-fa8a9542-dbc3-4f7c-aaa6-26eecfe23856 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:09.493652 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-07092674-6db3-429f-b596-25f7ca04fe00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:09.498398 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-07092674-6db3-429f-b596-25f7ca04fe00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:09.499166 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-07092674-6db3-429f-b596-25f7ca04fe00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:09.499652 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-07092674-6db3-429f-b596-25f7ca04fe00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:09.522945 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-8c265e4d-6426-4293-b313-34364c0db357 req-fa8a9542-dbc3-4f7c-aaa6-26eecfe23856 service nova] Creating event network-vif-deleted:f807a98a-f8e6-4868-ab21-4008a07a1ae4 for instance 7b84afb6-466c-477a-9339-b4a0ecef36be on hv-cinder-84327 Jun 16 00:33:09.528464 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-8c265e4d-6426-4293-b313-34364c0db357 req-fa8a9542-dbc3-4f7c-aaa6-26eecfe23856 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098078 Jun 16 00:33:09.529757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 347/718] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:09.593138 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-07092674-6db3-429f-b596-25f7ca04fe00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:09.602874 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-07092674-6db3-429f-b596-25f7ca04fe00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:09.604448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-07092674-6db3-429f-b596-25f7ca04fe00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:09.605609 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-07092674-6db3-429f-b596-25f7ca04fe00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 200 len: 1367 microversion: 2.20 time: 0.134359 Jun 16 00:33:09.622149 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 372/719] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:09 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:33:10.396635 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7987e6aa-172e-43dd-ae27-d576f79f7709 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:10.397706 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7987e6aa-172e-43dd-ae27-d576f79f7709 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:10.406087 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7987e6aa-172e-43dd-ae27-d576f79f7709 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:10.406561 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7987e6aa-172e-43dd-ae27-d576f79f7709 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:10.407351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7987e6aa-172e-43dd-ae27-d576f79f7709 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:10.408356 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7987e6aa-172e-43dd-ae27-d576f79f7709 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:10.561328 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7987e6aa-172e-43dd-ae27-d576f79f7709 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:10.570325 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7987e6aa-172e-43dd-ae27-d576f79f7709 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1367 microversion: 2.1 time: 0.179883 Jun 16 00:33:10.570887 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 348/720] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:10 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:10.624438 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-bd2118dc-3dc4-4dcb-a2f6-2887b2a8e3e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:10.625155 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-bd2118dc-3dc4-4dcb-a2f6-2887b2a8e3e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:10.632143 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bd2118dc-3dc4-4dcb-a2f6-2887b2a8e3e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:10.632659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bd2118dc-3dc4-4dcb-a2f6-2887b2a8e3e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:10.633387 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bd2118dc-3dc4-4dcb-a2f6-2887b2a8e3e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:10.633811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bd2118dc-3dc4-4dcb-a2f6-2887b2a8e3e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:10.648312 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-bd2118dc-3dc4-4dcb-a2f6-2887b2a8e3e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] HTTP exception thrown: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-bd2118dc-3dc4-4dcb-a2f6-2887b2a8e3e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Request method failure captured: Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be HTTP/1.1 Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnit5_a8sxQchl7G3i9_poufKrzSL5d0EqtQFOC78BPlaqkrNezLxV-10em7E1imQl5m78hfUzqMpM1Lc8QHeVbkCuBRTUU3fndr1S1fSosEZ9vcG0hfnhf2R8TiT7Zcgvd7czVJJiYefx_FHutlMUrcxkSFimFm0Rg3_tSZWYTVGBw Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 0a869108ba4446c4b767d186c5db253f Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:33:10.649964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:33:10.651745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a869108ba4446c4b767d186c5db253f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:33:10.651745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:33:10.651745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 0a869108ba4446c4b767d186c5db253f Jun 16 00:33:10.651745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:33:10.651745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-AttachVolumeShelveTestJSON-921110731-project Jun 16 00:33:10.651745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:33:10.651745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:33:10.651745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: a6c145cb49f54dd88307f416ff1bb92b Jun 16 00:33:10.651745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-921110731-project Jun 16 00:33:10.651745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:33:10.651745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:33:10.651745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '7b84afb6-466c-477a-9339-b4a0ecef36be'} Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:33:10.652605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:33:10.653863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:10.655130 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-bd2118dc-3dc4-4dcb-a2f6-2887b2a8e3e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Returning 404 to user: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:33:10.655130 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-bd2118dc-3dc4-4dcb-a2f6-2887b2a8e3e9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 404 len: 111 microversion: 2.20 time: 0.030968 Jun 16 00:33:10.655130 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 373/721] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:10 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:33:10.660563 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-08e1083b-fc33-4093-81bd-e2b2b8a23f72 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '.version_select at 0x7f9580439a60>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:10.679214 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-08e1083b-fc33-4093-81bd-e2b2b8a23f72 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383426794" status: 204 len: 0 microversion: 2.20 time: 0.022561 Jun 16 00:33:10.679817 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 349/722] 10.222.0.44 () {60 vars in 1261 bytes} [Thu Jun 16 00:33:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383426794 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 00:33:11.303594 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cd07fc94-04b3-4a98-8bd6-86c196109f13 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Action: 'create', calling method: .version_select at 0x7f9573c24160>, body: {"keypair": {"name": "tempest-keypair-942241172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIW9trEpcvSMV9DH49sCX5Go1NJVegFS/ZBECaWsNPoANCySt1PWnJwBx+VN20FeH4MsVUz4iRVGVatyMXCWx9LEB1rvDR6Cg9iNGKzr6j1kPiMoahv6FCOYc+3GoZb8Pw=="}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:11.317611 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-cd07fc94-04b3-4a98-8bd6-86c196109f13 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Getting quotas for project 0a869108ba4446c4b767d186c5db253f. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:33:11.321397 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-cd07fc94-04b3-4a98-8bd6-86c196109f13 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Getting quotas for user a6c145cb49f54dd88307f416ff1bb92b and project 0a869108ba4446c4b767d186c5db253f. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:33:11.343487 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-cd07fc94-04b3-4a98-8bd6-86c196109f13 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044356 Jun 16 00:33:11.344025 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 374/723] 10.222.0.44 () {62 vars in 1199 bytes} [Thu Jun 16 00:33:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 00:33:11.552076 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-1e48a161-0888-474d-be1b-72db41c33d01 req-ccc0d742-186d-460b-a9c6-c63db25e065a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a897b2e2-7e05-4ed8-8252-ddaad24dff1c", "tag": "5974f694-19d6-4042-9866-6cb0677cf33f"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:11.561177 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-1e48a161-0888-474d-be1b-72db41c33d01 req-ccc0d742-186d-460b-a9c6-c63db25e065a service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:11.561620 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-1e48a161-0888-474d-be1b-72db41c33d01 req-ccc0d742-186d-460b-a9c6-c63db25e065a service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:11.571890 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-1e48a161-0888-474d-be1b-72db41c33d01 req-ccc0d742-186d-460b-a9c6-c63db25e065a service nova] Creating event network-changed:5974f694-19d6-4042-9866-6cb0677cf33f for instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c on hv-cinder-84327 Jun 16 00:33:11.577630 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-1e48a161-0888-474d-be1b-72db41c33d01 req-ccc0d742-186d-460b-a9c6-c63db25e065a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030718 Jun 16 00:33:11.578228 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 350/724] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:11.586967 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3fbfc457-7840-4a9b-b078-f7f44d0c1088 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:11.587650 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-3fbfc457-7840-4a9b-b078-f7f44d0c1088 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:11.596130 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3fbfc457-7840-4a9b-b078-f7f44d0c1088 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:11.596520 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3fbfc457-7840-4a9b-b078-f7f44d0c1088 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:11.597324 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3fbfc457-7840-4a9b-b078-f7f44d0c1088 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:11.597950 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3fbfc457-7840-4a9b-b078-f7f44d0c1088 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:11.680007 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0739b91c-0d14-49be-9849-15054509aa58 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-519064835"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:11.680143 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0739b91c-0d14-49be-9849-15054509aa58 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:11.686701 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0739b91c-0d14-49be-9849-15054509aa58 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:11.687141 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0739b91c-0d14-49be-9849-15054509aa58 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:11.687940 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0739b91c-0d14-49be-9849-15054509aa58 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:11.688367 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0739b91c-0d14-49be-9849-15054509aa58 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:11.753135 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3fbfc457-7840-4a9b-b078-f7f44d0c1088 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:11.760979 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3fbfc457-7840-4a9b-b078-f7f44d0c1088 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1367 microversion: 2.1 time: 0.178270 Jun 16 00:33:11.761550 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 375/725] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:11 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:11.855154 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.network.security_group_api [None req-0739b91c-0d14-49be-9849-15054509aa58 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Removing security group 928ec3cb-115a-4f28-a97d-34dcb560ac4b from port ee01316d-3ff6-4e30-aa8e-9bdb422b6864 Jun 16 00:33:12.210152 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0739b91c-0d14-49be-9849-15054509aa58 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "POST /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/action" status: 202 len: 0 microversion: 2.1 time: 0.534943 Jun 16 00:33:12.212142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 351/726] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:33:11 2022] POST /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:33:12.221209 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-36c08876-7dd8-45ea-997e-2ccbf9dee861 req-da448d98-2f73-4fbb-8b14-16774be259ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f55ea4-7849-4165-9708-f6e0925a32e8", "tag": "ee01316d-3ff6-4e30-aa8e-9bdb422b6864"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:12.230819 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-36c08876-7dd8-45ea-997e-2ccbf9dee861 req-da448d98-2f73-4fbb-8b14-16774be259ce service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:12.231587 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-36c08876-7dd8-45ea-997e-2ccbf9dee861 req-da448d98-2f73-4fbb-8b14-16774be259ce service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:12.250095 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-36c08876-7dd8-45ea-997e-2ccbf9dee861 req-da448d98-2f73-4fbb-8b14-16774be259ce service nova] Creating event network-changed:ee01316d-3ff6-4e30-aa8e-9bdb422b6864 for instance c3f55ea4-7849-4165-9708-f6e0925a32e8 on hv-cinder-84327 Jun 16 00:33:12.256847 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-36c08876-7dd8-45ea-997e-2ccbf9dee861 req-da448d98-2f73-4fbb-8b14-16774be259ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044292 Jun 16 00:33:12.258191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 376/727] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:33:12.755139 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1309944112", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f10bbc9d-0adc-443a-9210-2ffe6856cac7"}], "security_groups": [{"name": "tempest-securitygroup--1621206000"}], "key_name": "tempest-keypair-942241172", "user_data": "}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:12.783202 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d0895917-adc7-4f44-852a-0046c2db42ee tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:12.784996 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d0895917-adc7-4f44-852a-0046c2db42ee tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:12.792886 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d0895917-adc7-4f44-852a-0046c2db42ee tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:12.793330 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d0895917-adc7-4f44-852a-0046c2db42ee tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:12.794112 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d0895917-adc7-4f44-852a-0046c2db42ee tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:12.794544 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d0895917-adc7-4f44-852a-0046c2db42ee tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:12.817580 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:12.997784 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] validate_networks() for [('f10bbc9d-0adc-443a-9210-2ffe6856cac7', None, None, None, None, None)] {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:33:13.085719 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d0895917-adc7-4f44-852a-0046c2db42ee tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:13.093063 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d0895917-adc7-4f44-852a-0046c2db42ee tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1367 microversion: 2.1 time: 0.316918 Jun 16 00:33:13.093618 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 377/728] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:12 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:13.919946 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:33:13.920381 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:33:13.920580 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:33:13.921050 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:33:13.921523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:33:13.933830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:13.934274 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:13.935069 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:13.935591 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:13.956931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Getting quotas for project 0a869108ba4446c4b767d186c5db253f. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:33:13.961346 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Getting quotas for user a6c145cb49f54dd88307f416ff1bb92b and project 0a869108ba4446c4b767d186c5db253f. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:33:13.974829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:33:13.977384 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:33:14.035403 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9d1e5ae2-04c7-4056-a97a-02ce32c59753 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.284489 Jun 16 00:33:14.036799 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 352/729] 10.222.0.44 () {62 vars in 1187 bytes} [Thu Jun 16 00:33:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 00:33:14.051781 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-74b9f679-ad93-4b12-9bdf-61e54a64c5c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:14.052384 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-74b9f679-ad93-4b12-9bdf-61e54a64c5c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:14.084935 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-caa19293-ee07-4d94-86c8-581162f84f43 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:14.085653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-caa19293-ee07-4d94-86c8-581162f84f43 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:14.094477 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-caa19293-ee07-4d94-86c8-581162f84f43 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:14.095752 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-caa19293-ee07-4d94-86c8-581162f84f43 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:14.096696 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-caa19293-ee07-4d94-86c8-581162f84f43 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:14.097290 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-caa19293-ee07-4d94-86c8-581162f84f43 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:14.165933 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-74b9f679-ad93-4b12-9bdf-61e54a64c5c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:14.174209 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-74b9f679-ad93-4b12-9bdf-61e54a64c5c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:14.181738 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-74b9f679-ad93-4b12-9bdf-61e54a64c5c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:14.183113 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-74b9f679-ad93-4b12-9bdf-61e54a64c5c3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1281 microversion: 2.20 time: 0.140695 Jun 16 00:33:14.186668 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 378/730] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:14 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:14.205039 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-95aaa025-fdc7-46b1-8067-a916e9835169 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:14.208404 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-95aaa025-fdc7-46b1-8067-a916e9835169 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:14.221116 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-95aaa025-fdc7-46b1-8067-a916e9835169 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:14.228652 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-95aaa025-fdc7-46b1-8067-a916e9835169 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:14.231738 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-95aaa025-fdc7-46b1-8067-a916e9835169 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:14.232328 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-95aaa025-fdc7-46b1-8067-a916e9835169 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:14.274148 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-caa19293-ee07-4d94-86c8-581162f84f43 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lazy-loading 'services' on Instance uuid c3f55ea4-7849-4165-9708-f6e0925a32e8 {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:33:14.409626 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-caa19293-ee07-4d94-86c8-581162f84f43 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments/da005172-239c-4d30-89fe-e6e92e30cc2d" status: 202 len: 0 microversion: 2.1 time: 0.328648 Jun 16 00:33:14.413440 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 353/731] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 16 00:33:14 2022] DELETE /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments/da005172-239c-4d30-89fe-e6e92e30cc2d => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:33:14.420336 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-bd78107f-b308-46e2-bcfa-4c800adc467a req-5225d18f-9220-4913-94af-288603860abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f55ea4-7849-4165-9708-f6e0925a32e8", "tag": "ee01316d-3ff6-4e30-aa8e-9bdb422b6864"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:14.434261 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-bd78107f-b308-46e2-bcfa-4c800adc467a req-5225d18f-9220-4913-94af-288603860abb service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:14.435605 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-bd78107f-b308-46e2-bcfa-4c800adc467a req-5225d18f-9220-4913-94af-288603860abb service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:14.441543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-95aaa025-fdc7-46b1-8067-a916e9835169 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:14.448858 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-bd78107f-b308-46e2-bcfa-4c800adc467a req-5225d18f-9220-4913-94af-288603860abb service nova] Creating event network-changed:ee01316d-3ff6-4e30-aa8e-9bdb422b6864 for instance c3f55ea4-7849-4165-9708-f6e0925a32e8 on hv-cinder-84327 Jun 16 00:33:14.455702 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-95aaa025-fdc7-46b1-8067-a916e9835169 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1367 microversion: 2.1 time: 0.256307 Jun 16 00:33:14.467944 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-bd78107f-b308-46e2-bcfa-4c800adc467a req-5225d18f-9220-4913-94af-288603860abb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052957 Jun 16 00:33:14.468775 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 379/733] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:14 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:14.468911 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 354/733] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:14.475813 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0a192d4f-6c5c-49b5-a5dd-8cfde78ff6c7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:14.476889 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0a192d4f-6c5c-49b5-a5dd-8cfde78ff6c7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:14.483120 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a192d4f-6c5c-49b5-a5dd-8cfde78ff6c7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:14.483577 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a192d4f-6c5c-49b5-a5dd-8cfde78ff6c7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:14.484373 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a192d4f-6c5c-49b5-a5dd-8cfde78ff6c7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:14.484810 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a192d4f-6c5c-49b5-a5dd-8cfde78ff6c7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:14.519233 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0a192d4f-6c5c-49b5-a5dd-8cfde78ff6c7 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049036 Jun 16 00:33:14.520335 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 355/734] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:33:14 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:15.205841 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a575ebd8-6d1e-418d-a346-cfeeec30fffa tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:15.207556 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a575ebd8-6d1e-418d-a346-cfeeec30fffa tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:15.212889 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:15.238796 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a575ebd8-6d1e-418d-a346-cfeeec30fffa tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:15.239539 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a575ebd8-6d1e-418d-a346-cfeeec30fffa tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:15.240615 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a575ebd8-6d1e-418d-a346-cfeeec30fffa tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:15.241146 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a575ebd8-6d1e-418d-a346-cfeeec30fffa tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:15.326058 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a575ebd8-6d1e-418d-a346-cfeeec30fffa tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:15.334298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a575ebd8-6d1e-418d-a346-cfeeec30fffa tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:15.335874 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a575ebd8-6d1e-418d-a346-cfeeec30fffa tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:15.337227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a575ebd8-6d1e-418d-a346-cfeeec30fffa tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1277 microversion: 2.20 time: 0.137001 Jun 16 00:33:15.337770 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 380/735] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:15 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:15.473003 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-56680fb6-d530-4061-90e5-ac5446d0f647 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:15.473615 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-56680fb6-d530-4061-90e5-ac5446d0f647 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:15.480065 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-56680fb6-d530-4061-90e5-ac5446d0f647 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:15.480504 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-56680fb6-d530-4061-90e5-ac5446d0f647 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:15.481260 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-56680fb6-d530-4061-90e5-ac5446d0f647 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:15.481685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-56680fb6-d530-4061-90e5-ac5446d0f647 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:15.530349 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-68c8297b-f451-4053-8d2f-db462e7ff884 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:15.531334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-68c8297b-f451-4053-8d2f-db462e7ff884 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:15.537910 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-68c8297b-f451-4053-8d2f-db462e7ff884 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:15.538353 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-68c8297b-f451-4053-8d2f-db462e7ff884 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:15.539105 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-68c8297b-f451-4053-8d2f-db462e7ff884 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:15.539535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-68c8297b-f451-4053-8d2f-db462e7ff884 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:15.570593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-68c8297b-f451-4053-8d2f-db462e7ff884 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044136 Jun 16 00:33:15.571150 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 381/736] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:33:15 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:33:15.616683 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-56680fb6-d530-4061-90e5-ac5446d0f647 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:15.624726 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-56680fb6-d530-4061-90e5-ac5446d0f647 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1367 microversion: 2.1 time: 0.155427 Jun 16 00:33:15.625270 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 356/737] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:15 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:16.355908 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d7a61f91-33df-4f0d-a6c3-8e3c8e888b6b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:16.356512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d7a61f91-33df-4f0d-a6c3-8e3c8e888b6b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:16.358422 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:16.364653 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d7a61f91-33df-4f0d-a6c3-8e3c8e888b6b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:16.365098 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d7a61f91-33df-4f0d-a6c3-8e3c8e888b6b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:16.365887 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d7a61f91-33df-4f0d-a6c3-8e3c8e888b6b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:16.366318 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d7a61f91-33df-4f0d-a6c3-8e3c8e888b6b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:16.450033 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d7a61f91-33df-4f0d-a6c3-8e3c8e888b6b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:16.459388 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d7a61f91-33df-4f0d-a6c3-8e3c8e888b6b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:16.461571 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d7a61f91-33df-4f0d-a6c3-8e3c8e888b6b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:16.462799 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d7a61f91-33df-4f0d-a6c3-8e3c8e888b6b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1339 microversion: 2.20 time: 0.110891 Jun 16 00:33:16.464139 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 382/738] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:16 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1339 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:16.582674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-086eafe2-0120-4296-8855-b605dd25548e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:16.584189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-086eafe2-0120-4296-8855-b605dd25548e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:16.591000 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-086eafe2-0120-4296-8855-b605dd25548e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:16.591670 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-086eafe2-0120-4296-8855-b605dd25548e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:16.592616 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-086eafe2-0120-4296-8855-b605dd25548e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:16.593235 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-086eafe2-0120-4296-8855-b605dd25548e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:16.623348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-086eafe2-0120-4296-8855-b605dd25548e tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044845 Jun 16 00:33:16.629574 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 357/739] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:33:16 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:33:16.634054 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cd7ad7df-6476-4538-a584-2b5e54afdd8f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:16.634556 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-cd7ad7df-6476-4538-a584-2b5e54afdd8f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:16.640923 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cd7ad7df-6476-4538-a584-2b5e54afdd8f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:16.641621 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cd7ad7df-6476-4538-a584-2b5e54afdd8f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:16.643082 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cd7ad7df-6476-4538-a584-2b5e54afdd8f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:16.643771 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cd7ad7df-6476-4538-a584-2b5e54afdd8f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:16.644711 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-35e8f654-948a-463e-83ea-4a49b279b698 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:16.646440 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-35e8f654-948a-463e-83ea-4a49b279b698 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:16.654797 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-35e8f654-948a-463e-83ea-4a49b279b698 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:16.655249 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-35e8f654-948a-463e-83ea-4a49b279b698 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:16.656116 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-35e8f654-948a-463e-83ea-4a49b279b698 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:16.656803 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-35e8f654-948a-463e-83ea-4a49b279b698 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:16.749023 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-cd7ad7df-6476-4538-a584-2b5e54afdd8f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] HTTP exception thrown: Instance c3f55ea4-7849-4165-9708-f6e0925a32e8 is not attached to volume da005172-239c-4d30-89fe-e6e92e30cc2d Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cd7ad7df-6476-4538-a584-2b5e54afdd8f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Request method failure captured: Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: DELETE /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments/da005172-239c-4d30-89fe-e6e92e30cc2d HTTP/1.1 Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnks5J8BZG9VNzVS4MQ6ycJ-U46cGHVF97_m0iE8L2Ta1g5SPswnuO1-cBiC5B5ppYTfpvzPdUslo_skJMLRcRg_Eyv-PtcDeKyY1uX-o4jyPvpxNP7Fv4R1pAXp_YMEigCd-lHLBleF4Z4PkV8-hblmV6rNdT2t76288WQSkR9Wbfg Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 4b5ec212032a46aab16a55fde900c916 Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-TestMinimumBasicScenario-634394990 Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:33:16.758543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:33:16.760309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b5ec212032a46aab16a55fde900c916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4b5ec212032a46aab16a55fde900c916"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b5ec212032a46aab16a55fde900c916"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4b5ec212032a46aab16a55fde900c916"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:33:16.760309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-TestMinimumBasicScenario-634394990 Jun 16 00:33:16.760309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 4b5ec212032a46aab16a55fde900c916 Jun 16 00:33:16.760309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-TestMinimumBasicScenario-634394990 Jun 16 00:33:16.760309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-TestMinimumBasicScenario-634394990-project Jun 16 00:33:16.760309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:33:16.760309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:33:16.760309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: ac127f66bf2b4432acd34132911d7c0c Jun 16 00:33:16.760309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-TestMinimumBasicScenario-634394990-project Jun 16 00:33:16.760309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:33:16.760309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance c3f55ea4-7849-4165-9708-f6e0925a32e8 is not attached to volume da005172-239c-4d30-89fe-e6e92e30cc2d Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'server_id': 'c3f55ea4-7849-4165-9708-f6e0925a32e8', 'id': 'da005172-239c-4d30-89fe-e6e92e30cc2d'} Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id da005172-239c-4d30-89fe-e6e92e30cc2d. Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:33:16.761152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3f55ea4-7849-4165-9708-f6e0925a32e8 is not attached to volume da005172-239c-4d30-89fe-e6e92e30cc2d Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3f55ea4-7849-4165-9708-f6e0925a32e8 is not attached to volume da005172-239c-4d30-89fe-e6e92e30cc2d Jun 16 00:33:16.762593 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:16.766275 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cd7ad7df-6476-4538-a584-2b5e54afdd8f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Returning 404 to user: Instance c3f55ea4-7849-4165-9708-f6e0925a32e8 is not attached to volume da005172-239c-4d30-89fe-e6e92e30cc2d {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:33:16.767710 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-cd7ad7df-6476-4538-a584-2b5e54afdd8f tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments/da005172-239c-4d30-89fe-e6e92e30cc2d" status: 404 len: 154 microversion: 2.1 time: 0.137137 Jun 16 00:33:16.768774 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 383/740] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 16 00:33:16 2022] DELETE /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8/os-volume_attachments/da005172-239c-4d30-89fe-e6e92e30cc2d => generated 154 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:33:16.921296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-35e8f654-948a-463e-83ea-4a49b279b698 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:16.930446 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-35e8f654-948a-463e-83ea-4a49b279b698 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1367 microversion: 2.1 time: 0.291602 Jun 16 00:33:16.930869 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 358/741] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:16 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:17.482891 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d07268ee-a039-4285-a861-67ee373b3829 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:17.489819 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d07268ee-a039-4285-a861-67ee373b3829 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:17.497101 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d07268ee-a039-4285-a861-67ee373b3829 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:17.497705 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d07268ee-a039-4285-a861-67ee373b3829 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:17.499229 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d07268ee-a039-4285-a861-67ee373b3829 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:17.499801 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d07268ee-a039-4285-a861-67ee373b3829 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:17.652886 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d07268ee-a039-4285-a861-67ee373b3829 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:17.670413 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d07268ee-a039-4285-a861-67ee373b3829 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:17.672543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d07268ee-a039-4285-a861-67ee373b3829 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:17.673906 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d07268ee-a039-4285-a861-67ee373b3829 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.195630 Jun 16 00:33:17.674676 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 384/742] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:17 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:17.708764 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-bfecd334-ec39-472e-b5dd-03b59de50a8c req-225de188-74e2-48ac-bb9a-770c784886c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a5a227f-6658-4f75-9193-65c781e2748f", "tag": "c16f9b3b-e924-4296-9815-07d0ab5a729b"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:17.722145 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-bfecd334-ec39-472e-b5dd-03b59de50a8c req-225de188-74e2-48ac-bb9a-770c784886c3 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:17.722546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-bfecd334-ec39-472e-b5dd-03b59de50a8c req-225de188-74e2-48ac-bb9a-770c784886c3 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:17.739676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-bfecd334-ec39-472e-b5dd-03b59de50a8c req-225de188-74e2-48ac-bb9a-770c784886c3 service nova] Creating event network-changed:c16f9b3b-e924-4296-9815-07d0ab5a729b for instance 3a5a227f-6658-4f75-9193-65c781e2748f on hv-cinder-84327 Jun 16 00:33:17.744913 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-bfecd334-ec39-472e-b5dd-03b59de50a8c req-225de188-74e2-48ac-bb9a-770c784886c3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042556 Jun 16 00:33:17.745518 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 359/743] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:33:17.943938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9b24c74f-49c4-462e-8337-df06fd747d70 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:17.944432 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9b24c74f-49c4-462e-8337-df06fd747d70 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:17.947768 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b6662f64-18d4-4fa3-8dea-e5eaaba1aa3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:17.948469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b6662f64-18d4-4fa3-8dea-e5eaaba1aa3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:17.950346 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9b24c74f-49c4-462e-8337-df06fd747d70 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:17.950793 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9b24c74f-49c4-462e-8337-df06fd747d70 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:17.951552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9b24c74f-49c4-462e-8337-df06fd747d70 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:17.952211 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9b24c74f-49c4-462e-8337-df06fd747d70 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:17.954655 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b6662f64-18d4-4fa3-8dea-e5eaaba1aa3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:17.955109 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b6662f64-18d4-4fa3-8dea-e5eaaba1aa3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:17.957481 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b6662f64-18d4-4fa3-8dea-e5eaaba1aa3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:17.957481 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b6662f64-18d4-4fa3-8dea-e5eaaba1aa3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:17.976988 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9b24c74f-49c4-462e-8337-df06fd747d70 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Going to try to terminate instance {{(pid=129466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:33:18.063265 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9b24c74f-49c4-462e-8337-df06fd747d70 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 204 len: 0 microversion: 2.1 time: 0.122815 Jun 16 00:33:18.064431 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 385/744] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:33:17 2022] DELETE /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:33:18.072922 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-08b127a9-9ad1-419b-a45a-67e112f64770 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:18.073679 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-08b127a9-9ad1-419b-a45a-67e112f64770 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:18.080026 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-08b127a9-9ad1-419b-a45a-67e112f64770 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:18.080477 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-08b127a9-9ad1-419b-a45a-67e112f64770 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:18.081298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-08b127a9-9ad1-419b-a45a-67e112f64770 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:18.081737 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-08b127a9-9ad1-419b-a45a-67e112f64770 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:18.103321 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b6662f64-18d4-4fa3-8dea-e5eaaba1aa3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:18.111380 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b6662f64-18d4-4fa3-8dea-e5eaaba1aa3b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1367 microversion: 2.1 time: 0.167175 Jun 16 00:33:18.111981 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 360/745] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:17 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:18.222372 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-08b127a9-9ad1-419b-a45a-67e112f64770 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:18.231344 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-08b127a9-9ad1-419b-a45a-67e112f64770 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1553 microversion: 2.1 time: 0.162418 Jun 16 00:33:18.232058 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 386/746] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:18 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:18.354766 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-b683d223-04f5-40ec-b36f-f64275b5e01a req-f6ea6035-2f32-4822-a01f-3f612a1e7f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a897b2e2-7e05-4ed8-8252-ddaad24dff1c", "name": "network-vif-plugged", "status": "completed", "tag": "5974f694-19d6-4042-9866-6cb0677cf33f"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:18.369972 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-b683d223-04f5-40ec-b36f-f64275b5e01a req-f6ea6035-2f32-4822-a01f-3f612a1e7f6b service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:18.370413 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-b683d223-04f5-40ec-b36f-f64275b5e01a req-f6ea6035-2f32-4822-a01f-3f612a1e7f6b service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:18.381026 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-b683d223-04f5-40ec-b36f-f64275b5e01a req-f6ea6035-2f32-4822-a01f-3f612a1e7f6b service nova] Creating event network-vif-plugged:5974f694-19d6-4042-9866-6cb0677cf33f for instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c on hv-cinder-84327 Jun 16 00:33:18.385647 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-b683d223-04f5-40ec-b36f-f64275b5e01a req-f6ea6035-2f32-4822-a01f-3f612a1e7f6b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089726 Jun 16 00:33:18.386213 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 361/747] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:18.692918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-53edead3-d05d-4a15-984b-b234d8d98a39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:18.693427 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-53edead3-d05d-4a15-984b-b234d8d98a39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:18.699914 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-53edead3-d05d-4a15-984b-b234d8d98a39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:18.700373 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-53edead3-d05d-4a15-984b-b234d8d98a39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:18.701145 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-53edead3-d05d-4a15-984b-b234d8d98a39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:18.701586 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-53edead3-d05d-4a15-984b-b234d8d98a39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:18.831064 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-53edead3-d05d-4a15-984b-b234d8d98a39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:18.838970 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-53edead3-d05d-4a15-984b-b234d8d98a39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:18.840497 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-53edead3-d05d-4a15-984b-b234d8d98a39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:18.841602 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-53edead3-d05d-4a15-984b-b234d8d98a39 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.153301 Jun 16 00:33:18.842155 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 387/748] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:18 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:19.129756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8a20717c-a91b-4904-b70b-42ff1e257bdb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:19.130709 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8a20717c-a91b-4904-b70b-42ff1e257bdb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:19.133666 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:19.137718 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8a20717c-a91b-4904-b70b-42ff1e257bdb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:19.138164 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8a20717c-a91b-4904-b70b-42ff1e257bdb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:19.138923 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8a20717c-a91b-4904-b70b-42ff1e257bdb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:19.139354 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8a20717c-a91b-4904-b70b-42ff1e257bdb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:19.247893 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4e0a9cd2-707a-4c9d-8c22-95eb39bb9b87 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:19.248505 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4e0a9cd2-707a-4c9d-8c22-95eb39bb9b87 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:19.254568 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4e0a9cd2-707a-4c9d-8c22-95eb39bb9b87 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:19.255013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4e0a9cd2-707a-4c9d-8c22-95eb39bb9b87 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:19.255806 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4e0a9cd2-707a-4c9d-8c22-95eb39bb9b87 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:19.256242 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4e0a9cd2-707a-4c9d-8c22-95eb39bb9b87 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:19.267935 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8a20717c-a91b-4904-b70b-42ff1e257bdb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:19.275537 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8a20717c-a91b-4904-b70b-42ff1e257bdb tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1367 microversion: 2.1 time: 0.150954 Jun 16 00:33:19.276329 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 362/749] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:19 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:19.380380 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4e0a9cd2-707a-4c9d-8c22-95eb39bb9b87 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:19.387563 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4e0a9cd2-707a-4c9d-8c22-95eb39bb9b87 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1553 microversion: 2.1 time: 0.143563 Jun 16 00:33:19.388149 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 388/750] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:19 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1553 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:19.859440 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-94b6e411-aea4-4bc3-99ba-c53e9bd07bd6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:19.860071 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-94b6e411-aea4-4bc3-99ba-c53e9bd07bd6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:19.866100 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-94b6e411-aea4-4bc3-99ba-c53e9bd07bd6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:19.866554 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-94b6e411-aea4-4bc3-99ba-c53e9bd07bd6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:19.867323 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-94b6e411-aea4-4bc3-99ba-c53e9bd07bd6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:19.867842 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-94b6e411-aea4-4bc3-99ba-c53e9bd07bd6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:20.013487 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-94b6e411-aea4-4bc3-99ba-c53e9bd07bd6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:20.022329 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-94b6e411-aea4-4bc3-99ba-c53e9bd07bd6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:20.023848 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-94b6e411-aea4-4bc3-99ba-c53e9bd07bd6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:20.026286 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-94b6e411-aea4-4bc3-99ba-c53e9bd07bd6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.170822 Jun 16 00:33:20.026876 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 363/751] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:19 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:20.292711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a61e21b5-b3cd-4efa-badd-d7f769a67886 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:20.293308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a61e21b5-b3cd-4efa-badd-d7f769a67886 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:20.299820 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a61e21b5-b3cd-4efa-badd-d7f769a67886 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:20.300207 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a61e21b5-b3cd-4efa-badd-d7f769a67886 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:20.300962 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a61e21b5-b3cd-4efa-badd-d7f769a67886 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:20.301389 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a61e21b5-b3cd-4efa-badd-d7f769a67886 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:20.404896 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ad5900c3-565f-41c0-9093-9e2832c0ce83 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:20.405510 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ad5900c3-565f-41c0-9093-9e2832c0ce83 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:20.412559 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ad5900c3-565f-41c0-9093-9e2832c0ce83 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:20.412999 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ad5900c3-565f-41c0-9093-9e2832c0ce83 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:20.413761 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ad5900c3-565f-41c0-9093-9e2832c0ce83 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:20.414187 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ad5900c3-565f-41c0-9093-9e2832c0ce83 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:20.432331 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a61e21b5-b3cd-4efa-badd-d7f769a67886 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:20.439674 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a61e21b5-b3cd-4efa-badd-d7f769a67886 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1367 microversion: 2.1 time: 0.150730 Jun 16 00:33:20.440238 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 389/752] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:20 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:20.543147 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ad5900c3-565f-41c0-9093-9e2832c0ce83 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:20.550584 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ad5900c3-565f-41c0-9093-9e2832c0ce83 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1553 microversion: 2.1 time: 0.149390 Jun 16 00:33:20.551083 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 364/753] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:20 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:21.044784 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-110eda24-8aba-4a8b-aa6f-5a5193e95403 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:21.045430 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-110eda24-8aba-4a8b-aa6f-5a5193e95403 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:21.052772 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-110eda24-8aba-4a8b-aa6f-5a5193e95403 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:21.053158 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-110eda24-8aba-4a8b-aa6f-5a5193e95403 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:21.053920 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-110eda24-8aba-4a8b-aa6f-5a5193e95403 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:21.054351 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-110eda24-8aba-4a8b-aa6f-5a5193e95403 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:21.182383 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-110eda24-8aba-4a8b-aa6f-5a5193e95403 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:21.190309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-110eda24-8aba-4a8b-aa6f-5a5193e95403 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:21.191817 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-110eda24-8aba-4a8b-aa6f-5a5193e95403 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:21.192904 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-110eda24-8aba-4a8b-aa6f-5a5193e95403 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.152196 Jun 16 00:33:21.193451 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 390/754] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:21 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:21.457367 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-fdd454b9-2d35-493b-aa66-4ae72f779c7b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:21.457984 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-fdd454b9-2d35-493b-aa66-4ae72f779c7b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:21.464029 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fdd454b9-2d35-493b-aa66-4ae72f779c7b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:21.464472 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fdd454b9-2d35-493b-aa66-4ae72f779c7b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:21.465232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fdd454b9-2d35-493b-aa66-4ae72f779c7b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:21.465663 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fdd454b9-2d35-493b-aa66-4ae72f779c7b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:21.469536 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:21.567880 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-db920372-269c-4ce8-a0f1-9df8f723f641 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:21.568519 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-db920372-269c-4ce8-a0f1-9df8f723f641 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:21.574944 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-db920372-269c-4ce8-a0f1-9df8f723f641 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:21.575389 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-db920372-269c-4ce8-a0f1-9df8f723f641 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:21.576188 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-db920372-269c-4ce8-a0f1-9df8f723f641 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:21.576621 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-db920372-269c-4ce8-a0f1-9df8f723f641 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:21.593094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fdd454b9-2d35-493b-aa66-4ae72f779c7b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:21.600541 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-fdd454b9-2d35-493b-aa66-4ae72f779c7b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1367 microversion: 2.1 time: 0.148056 Jun 16 00:33:21.601139 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 365/755] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:21 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:21.702752 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-db920372-269c-4ce8-a0f1-9df8f723f641 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:21.710804 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-db920372-269c-4ce8-a0f1-9df8f723f641 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1553 microversion: 2.1 time: 0.147309 Jun 16 00:33:21.711298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 391/756] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:21 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:22.210484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1f750112-3687-4949-b6f7-0eb0b82cc7ac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:22.211096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1f750112-3687-4949-b6f7-0eb0b82cc7ac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:22.217050 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1f750112-3687-4949-b6f7-0eb0b82cc7ac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:22.217498 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1f750112-3687-4949-b6f7-0eb0b82cc7ac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:22.218261 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1f750112-3687-4949-b6f7-0eb0b82cc7ac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:22.218697 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1f750112-3687-4949-b6f7-0eb0b82cc7ac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:22.349193 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1f750112-3687-4949-b6f7-0eb0b82cc7ac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:22.357054 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1f750112-3687-4949-b6f7-0eb0b82cc7ac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:22.358541 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1f750112-3687-4949-b6f7-0eb0b82cc7ac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:22.359698 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1f750112-3687-4949-b6f7-0eb0b82cc7ac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.153000 Jun 16 00:33:22.360252 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 366/757] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:22 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:22.617800 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f5a4f154-23d8-46aa-9619-2de902d89757 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:22.618349 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f5a4f154-23d8-46aa-9619-2de902d89757 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:22.624814 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f5a4f154-23d8-46aa-9619-2de902d89757 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:22.625267 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f5a4f154-23d8-46aa-9619-2de902d89757 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:22.626040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f5a4f154-23d8-46aa-9619-2de902d89757 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:22.626482 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f5a4f154-23d8-46aa-9619-2de902d89757 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:22.727280 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f5a25452-d4d8-4452-aede-ba0de92627b0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:22.727916 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f5a25452-d4d8-4452-aede-ba0de92627b0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:22.734371 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f5a25452-d4d8-4452-aede-ba0de92627b0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:22.734824 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f5a25452-d4d8-4452-aede-ba0de92627b0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:22.735665 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f5a25452-d4d8-4452-aede-ba0de92627b0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:22.736111 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f5a25452-d4d8-4452-aede-ba0de92627b0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:22.757581 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f5a4f154-23d8-46aa-9619-2de902d89757 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:22.765033 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f5a4f154-23d8-46aa-9619-2de902d89757 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1367 microversion: 2.1 time: 0.151138 Jun 16 00:33:22.765599 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 392/758] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:22 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:22.872106 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f5a25452-d4d8-4452-aede-ba0de92627b0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:22.879809 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f5a25452-d4d8-4452-aede-ba0de92627b0 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1553 microversion: 2.1 time: 0.156284 Jun 16 00:33:22.880382 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 367/759] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:22 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:22.911872 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-84ad1f6f-adfc-409b-b6e6-164e4db152f1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:22.912363 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-84ad1f6f-adfc-409b-b6e6-164e4db152f1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:22.918573 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-84ad1f6f-adfc-409b-b6e6-164e4db152f1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:22.919025 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-84ad1f6f-adfc-409b-b6e6-164e4db152f1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:22.919837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-84ad1f6f-adfc-409b-b6e6-164e4db152f1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:22.920276 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-84ad1f6f-adfc-409b-b6e6-164e4db152f1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:22.937505 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:23.000533 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.objects.instance [None req-84ad1f6f-adfc-409b-b6e6-164e4db152f1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lazy-loading 'services' on Instance uuid f4a2ac88-a177-4fc8-867b-eef87107e914 {{(pid=129466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:33:23.070008 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-84ad1f6f-adfc-409b-b6e6-164e4db152f1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments/6a36d455-6fe9-4d74-aec4-c833744606ea" status: 202 len: 0 microversion: 2.1 time: 0.162384 Jun 16 00:33:23.070578 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 393/760] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 16 00:33:22 2022] DELETE /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments/6a36d455-6fe9-4d74-aec4-c833744606ea => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:33:23.078699 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-cdd5b44e-0595-4d84-b1e0-796e28f1f030 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:23.080241 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-cdd5b44e-0595-4d84-b1e0-796e28f1f030 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:23.086221 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cdd5b44e-0595-4d84-b1e0-796e28f1f030 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:23.086672 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cdd5b44e-0595-4d84-b1e0-796e28f1f030 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:23.087439 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cdd5b44e-0595-4d84-b1e0-796e28f1f030 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:23.087907 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cdd5b44e-0595-4d84-b1e0-796e28f1f030 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:23.115700 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-cdd5b44e-0595-4d84-b1e0-796e28f1f030 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040888 Jun 16 00:33:23.116248 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 368/761] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:33:23 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:23.378900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a109beca-b4f2-4f88-ab74-0b93cb3aae7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:23.379469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a109beca-b4f2-4f88-ab74-0b93cb3aae7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:23.385862 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a109beca-b4f2-4f88-ab74-0b93cb3aae7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:23.386315 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a109beca-b4f2-4f88-ab74-0b93cb3aae7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:23.387079 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a109beca-b4f2-4f88-ab74-0b93cb3aae7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:23.387517 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a109beca-b4f2-4f88-ab74-0b93cb3aae7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:23.515168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a109beca-b4f2-4f88-ab74-0b93cb3aae7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:23.523372 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a109beca-b4f2-4f88-ab74-0b93cb3aae7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:23.524891 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a109beca-b4f2-4f88-ab74-0b93cb3aae7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:23.525983 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a109beca-b4f2-4f88-ab74-0b93cb3aae7b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.151507 Jun 16 00:33:23.526530 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 394/762] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:23 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:23.782359 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bdc93236-5068-46c8-8bab-9470776a8070 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:23.783000 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bdc93236-5068-46c8-8bab-9470776a8070 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:23.789517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bdc93236-5068-46c8-8bab-9470776a8070 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:23.789964 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bdc93236-5068-46c8-8bab-9470776a8070 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:23.790727 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bdc93236-5068-46c8-8bab-9470776a8070 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:23.791162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bdc93236-5068-46c8-8bab-9470776a8070 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:23.897733 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-45249721-9ff7-4f8b-89b6-a443fc25c09c tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:23.899120 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-45249721-9ff7-4f8b-89b6-a443fc25c09c tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:23.913305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-45249721-9ff7-4f8b-89b6-a443fc25c09c tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:23.914140 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-45249721-9ff7-4f8b-89b6-a443fc25c09c tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:23.914578 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-45249721-9ff7-4f8b-89b6-a443fc25c09c tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:23.915233 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-45249721-9ff7-4f8b-89b6-a443fc25c09c tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:23.944798 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:23.970268 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=6 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:23.979537 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bdc93236-5068-46c8-8bab-9470776a8070 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:23.987040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bdc93236-5068-46c8-8bab-9470776a8070 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1367 microversion: 2.1 time: 0.208428 Jun 16 00:33:23.987593 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 369/763] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:23 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:24.062564 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-45249721-9ff7-4f8b-89b6-a443fc25c09c tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:24.070599 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-45249721-9ff7-4f8b-89b6-a443fc25c09c tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1553 microversion: 2.1 time: 0.178500 Jun 16 00:33:24.071165 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 395/764] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:23 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:24.128958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8b804415-aa8b-4955-a59c-34fdf6685889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:24.129936 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8b804415-aa8b-4955-a59c-34fdf6685889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:24.135957 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8b804415-aa8b-4955-a59c-34fdf6685889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:24.136407 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8b804415-aa8b-4955-a59c-34fdf6685889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:24.137163 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8b804415-aa8b-4955-a59c-34fdf6685889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:24.137595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8b804415-aa8b-4955-a59c-34fdf6685889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:24.167672 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8b804415-aa8b-4955-a59c-34fdf6685889 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043246 Jun 16 00:33:24.168226 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 370/765] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:33:24 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:24.543953 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-db66386f-ec15-4ddd-bb3d-612ce337a9c9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:24.544559 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-db66386f-ec15-4ddd-bb3d-612ce337a9c9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:24.547013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=18 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:24.553418 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-db66386f-ec15-4ddd-bb3d-612ce337a9c9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:24.553867 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-db66386f-ec15-4ddd-bb3d-612ce337a9c9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:24.554643 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-db66386f-ec15-4ddd-bb3d-612ce337a9c9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:24.555077 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-db66386f-ec15-4ddd-bb3d-612ce337a9c9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:24.686199 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-db66386f-ec15-4ddd-bb3d-612ce337a9c9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:24.694767 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-db66386f-ec15-4ddd-bb3d-612ce337a9c9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:24.696387 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-db66386f-ec15-4ddd-bb3d-612ce337a9c9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:24.697613 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-db66386f-ec15-4ddd-bb3d-612ce337a9c9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.157655 Jun 16 00:33:24.698284 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 396/766] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:24 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:24.859152 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-b789e821-7d5f-4113-9c49-5a27642e8510 req-5cb5486f-54f8-4175-8394-afaabc21de8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3f55ea4-7849-4165-9708-f6e0925a32e8", "name": "network-vif-deleted", "tag": "ee01316d-3ff6-4e30-aa8e-9bdb422b6864"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:24.867969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-b789e821-7d5f-4113-9c49-5a27642e8510 req-5cb5486f-54f8-4175-8394-afaabc21de8f service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:24.868411 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-b789e821-7d5f-4113-9c49-5a27642e8510 req-5cb5486f-54f8-4175-8394-afaabc21de8f service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:24.880107 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-b789e821-7d5f-4113-9c49-5a27642e8510 req-5cb5486f-54f8-4175-8394-afaabc21de8f service nova] Creating event network-vif-deleted:ee01316d-3ff6-4e30-aa8e-9bdb422b6864 for instance c3f55ea4-7849-4165-9708-f6e0925a32e8 on hv-cinder-84327 Jun 16 00:33:24.887580 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-b789e821-7d5f-4113-9c49-5a27642e8510 req-5cb5486f-54f8-4175-8394-afaabc21de8f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031950 Jun 16 00:33:24.888972 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 371/767] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:25.004241 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-aab1d80b-b943-4e0b-a8c5-88c0be7824fc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:25.004851 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-aab1d80b-b943-4e0b-a8c5-88c0be7824fc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:25.011270 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aab1d80b-b943-4e0b-a8c5-88c0be7824fc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.011733 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aab1d80b-b943-4e0b-a8c5-88c0be7824fc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.013358 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aab1d80b-b943-4e0b-a8c5-88c0be7824fc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.013922 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aab1d80b-b943-4e0b-a8c5-88c0be7824fc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.088453 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c173a2f2-1eee-45a9-9789-a82f3eb8a3bb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:25.089069 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c173a2f2-1eee-45a9-9789-a82f3eb8a3bb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:25.097063 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c173a2f2-1eee-45a9-9789-a82f3eb8a3bb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.097532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c173a2f2-1eee-45a9-9789-a82f3eb8a3bb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.098526 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c173a2f2-1eee-45a9-9789-a82f3eb8a3bb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.099052 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c173a2f2-1eee-45a9-9789-a82f3eb8a3bb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.130489 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c173a2f2-1eee-45a9-9789-a82f3eb8a3bb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.130944 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c173a2f2-1eee-45a9-9789-a82f3eb8a3bb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.131427 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-c173a2f2-1eee-45a9-9789-a82f3eb8a3bb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lazy-loading 'fault' on Instance uuid c3f55ea4-7849-4165-9708-f6e0925a32e8 {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:33:25.207710 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c173a2f2-1eee-45a9-9789-a82f3eb8a3bb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac127f66bf2b4432acd34132911d7c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5ec212032a46aab16a55fde900c916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:25.211291 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-aab1d80b-b943-4e0b-a8c5-88c0be7824fc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:25.218785 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c173a2f2-1eee-45a9-9789-a82f3eb8a3bb tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 200 len: 1349 microversion: 2.1 time: 0.134287 Jun 16 00:33:25.230223 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 372/768] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:25 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 1349 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:25.232245 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-aab1d80b-b943-4e0b-a8c5-88c0be7824fc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1557 microversion: 2.1 time: 0.232093 Jun 16 00:33:25.233092 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 397/769] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:24 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1557 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:25.236587 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d57e70ec-9264-4ee8-a199-b0e750a61564 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:25.237518 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d57e70ec-9264-4ee8-a199-b0e750a61564 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:25.245276 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d57e70ec-9264-4ee8-a199-b0e750a61564 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.245823 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d57e70ec-9264-4ee8-a199-b0e750a61564 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.247046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d57e70ec-9264-4ee8-a199-b0e750a61564 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.247554 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d57e70ec-9264-4ee8-a199-b0e750a61564 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.254535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-262e4cc8-965f-4891-9f44-dd5d9a1194bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:25.254680 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-262e4cc8-965f-4891-9f44-dd5d9a1194bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:25.261035 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-262e4cc8-965f-4891-9f44-dd5d9a1194bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.261548 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-262e4cc8-965f-4891-9f44-dd5d9a1194bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.262806 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-262e4cc8-965f-4891-9f44-dd5d9a1194bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.262806 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-262e4cc8-965f-4891-9f44-dd5d9a1194bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.286186 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d57e70ec-9264-4ee8-a199-b0e750a61564 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054447 Jun 16 00:33:25.287276 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 373/770] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:33:25 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:25.366783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-262e4cc8-965f-4891-9f44-dd5d9a1194bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119107 Jun 16 00:33:25.367369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 398/771] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 16 00:33:25 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:33:25.716673 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0d04be1a-88c6-4c48-8156-c5850933995b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:25.717538 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0d04be1a-88c6-4c48-8156-c5850933995b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:25.723829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d04be1a-88c6-4c48-8156-c5850933995b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.724380 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d04be1a-88c6-4c48-8156-c5850933995b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.725224 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d04be1a-88c6-4c48-8156-c5850933995b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:25.725730 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0d04be1a-88c6-4c48-8156-c5850933995b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:25.983853 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0d04be1a-88c6-4c48-8156-c5850933995b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:25.992624 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0d04be1a-88c6-4c48-8156-c5850933995b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:25.994463 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0d04be1a-88c6-4c48-8156-c5850933995b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:25.995586 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0d04be1a-88c6-4c48-8156-c5850933995b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.283118 Jun 16 00:33:25.996164 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 374/772] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:25 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:26.237599 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7468ec8c-c9f8-4433-8e01-b0e3442b5344 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:26.238217 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7468ec8c-c9f8-4433-8e01-b0e3442b5344 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] [instance: c3f55ea4-7849-4165-9708-f6e0925a32e8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:26.245148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7468ec8c-c9f8-4433-8e01-b0e3442b5344 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:26.245599 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7468ec8c-c9f8-4433-8e01-b0e3442b5344 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:26.246561 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7468ec8c-c9f8-4433-8e01-b0e3442b5344 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:26.247155 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7468ec8c-c9f8-4433-8e01-b0e3442b5344 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:26.261791 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-7468ec8c-c9f8-4433-8e01-b0e3442b5344 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] HTTP exception thrown: Instance c3f55ea4-7849-4165-9708-f6e0925a32e8 could not be found. Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7468ec8c-c9f8-4433-8e01-b0e3442b5344 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Request method failure captured: Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 HTTP/1.1 Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnks5J8BZG9VNzVS4MQ6ycJ-U46cGHVF97_m0iE8L2Ta1g5SPswnuO1-cBiC5B5ppYTfpvzPdUslo_skJMLRcRg_Eyv-PtcDeKyY1uX-o4jyPvpxNP7Fv4R1pAXp_YMEigCd-lHLBleF4Z4PkV8-hblmV6rNdT2t76288WQSkR9Wbfg Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 4b5ec212032a46aab16a55fde900c916 Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-TestMinimumBasicScenario-634394990 Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:33:26.263917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:33:26.265485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b5ec212032a46aab16a55fde900c916"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4b5ec212032a46aab16a55fde900c916"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4b5ec212032a46aab16a55fde900c916"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4b5ec212032a46aab16a55fde900c916"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:33:26.265485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-TestMinimumBasicScenario-634394990 Jun 16 00:33:26.265485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 4b5ec212032a46aab16a55fde900c916 Jun 16 00:33:26.265485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-TestMinimumBasicScenario-634394990 Jun 16 00:33:26.265485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-TestMinimumBasicScenario-634394990-project Jun 16 00:33:26.265485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:33:26.265485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:33:26.265485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: ac127f66bf2b4432acd34132911d7c0c Jun 16 00:33:26.265485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-TestMinimumBasicScenario-634394990-project Jun 16 00:33:26.265485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:33:26.265485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance c3f55ea4-7849-4165-9708-f6e0925a32e8 could not be found. Jun 16 00:33:26.265485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': 'c3f55ea4-7849-4165-9708-f6e0925a32e8'} Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3f55ea4-7849-4165-9708-f6e0925a32e8 could not be found. Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:33:26.266393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3f55ea4-7849-4165-9708-f6e0925a32e8 could not be found. Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3f55ea4-7849-4165-9708-f6e0925a32e8 could not be found. Jun 16 00:33:26.268496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:26.271021 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7468ec8c-c9f8-4433-8e01-b0e3442b5344 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Returning 404 to user: Instance c3f55ea4-7849-4165-9708-f6e0925a32e8 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:33:26.271021 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7468ec8c-c9f8-4433-8e01-b0e3442b5344 tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8" status: 404 len: 111 microversion: 2.1 time: 0.037602 Jun 16 00:33:26.271021 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 399/773] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:26 2022] GET /compute/v2.1/servers/c3f55ea4-7849-4165-9708-f6e0925a32e8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:33:26.279198 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-20303299-57dc-41a6-9773-89f1f33b69ee tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] Calling method '.version_select at 0x7f9580314310>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:26.299812 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-20303299-57dc-41a6-9773-89f1f33b69ee tempest-TestMinimumBasicScenario-634394990 tempest-TestMinimumBasicScenario-634394990-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1892271095" status: 202 len: 0 microversion: 2.1 time: 0.024393 Jun 16 00:33:26.300849 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 375/774] 10.222.0.44 () {58 vars in 1271 bytes} [Thu Jun 16 00:33:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1892271095 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:33:26.301957 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-21b4221b-c63c-41bf-ab6e-50859c9a33bf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:26.302989 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-21b4221b-c63c-41bf-ab6e-50859c9a33bf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:26.309388 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-21b4221b-c63c-41bf-ab6e-50859c9a33bf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:26.309842 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-21b4221b-c63c-41bf-ab6e-50859c9a33bf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:26.310616 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-21b4221b-c63c-41bf-ab6e-50859c9a33bf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:26.311217 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-21b4221b-c63c-41bf-ab6e-50859c9a33bf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:26.343744 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-21b4221b-c63c-41bf-ab6e-50859c9a33bf tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049313 Jun 16 00:33:26.345817 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 400/775] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:33:26 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:33:26.424838 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b6e68f36-e3cf-49b1-acbd-e3ed7eedfbdb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:26.425257 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b6e68f36-e3cf-49b1-acbd-e3ed7eedfbdb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:26.431589 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b6e68f36-e3cf-49b1-acbd-e3ed7eedfbdb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:26.432072 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b6e68f36-e3cf-49b1-acbd-e3ed7eedfbdb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:26.432930 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b6e68f36-e3cf-49b1-acbd-e3ed7eedfbdb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:26.433268 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b6e68f36-e3cf-49b1-acbd-e3ed7eedfbdb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:26.464675 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b6e68f36-e3cf-49b1-acbd-e3ed7eedfbdb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Going to try to terminate instance {{(pid=129465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:33:26.554762 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b6e68f36-e3cf-49b1-acbd-e3ed7eedfbdb tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 204 len: 0 microversion: 2.1 time: 0.134613 Jun 16 00:33:26.559289 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 376/776] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:33:26 2022] DELETE /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:33:26.564837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9c3b48bd-e2f7-4c52-86a7-44c9a88f904d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:26.565419 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9c3b48bd-e2f7-4c52-86a7-44c9a88f904d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:26.572119 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9c3b48bd-e2f7-4c52-86a7-44c9a88f904d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:26.572575 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9c3b48bd-e2f7-4c52-86a7-44c9a88f904d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:26.573355 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9c3b48bd-e2f7-4c52-86a7-44c9a88f904d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:26.573972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9c3b48bd-e2f7-4c52-86a7-44c9a88f904d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:26.812636 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9c3b48bd-e2f7-4c52-86a7-44c9a88f904d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:26.824054 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9c3b48bd-e2f7-4c52-86a7-44c9a88f904d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1691 microversion: 2.1 time: 0.263057 Jun 16 00:33:26.827361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 401/777] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:26 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1691 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:26.837463 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-11c9d4fc-9b17-4758-8051-406e4ce391a6 req-a01dad3e-ad5c-40eb-9735-dd68610c72c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a897b2e2-7e05-4ed8-8252-ddaad24dff1c", "tag": "5974f694-19d6-4042-9866-6cb0677cf33f"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:26.846174 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-11c9d4fc-9b17-4758-8051-406e4ce391a6 req-a01dad3e-ad5c-40eb-9735-dd68610c72c2 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:26.846615 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-11c9d4fc-9b17-4758-8051-406e4ce391a6 req-a01dad3e-ad5c-40eb-9735-dd68610c72c2 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:26.869935 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-11c9d4fc-9b17-4758-8051-406e4ce391a6 req-a01dad3e-ad5c-40eb-9735-dd68610c72c2 service nova] Creating event network-changed:5974f694-19d6-4042-9866-6cb0677cf33f for instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c on hv-cinder-84327 Jun 16 00:33:26.877674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-11c9d4fc-9b17-4758-8051-406e4ce391a6 req-a01dad3e-ad5c-40eb-9735-dd68610c72c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054140 Jun 16 00:33:26.879280 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 377/778] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:33:27.014048 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-98c04705-a1a1-4db7-a06f-a001122b16d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:27.014661 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-98c04705-a1a1-4db7-a06f-a001122b16d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:27.021610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-98c04705-a1a1-4db7-a06f-a001122b16d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:27.022135 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-98c04705-a1a1-4db7-a06f-a001122b16d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:27.022928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-98c04705-a1a1-4db7-a06f-a001122b16d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:27.023368 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-98c04705-a1a1-4db7-a06f-a001122b16d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:27.236569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-98c04705-a1a1-4db7-a06f-a001122b16d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:27.245239 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-98c04705-a1a1-4db7-a06f-a001122b16d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:27.247445 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-98c04705-a1a1-4db7-a06f-a001122b16d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:27.248762 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-98c04705-a1a1-4db7-a06f-a001122b16d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.238701 Jun 16 00:33:27.257023 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 402/779] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:27 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:27.845160 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bac2d2c9-97e4-4647-83e3-e0f354dc2579 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:27.845900 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bac2d2c9-97e4-4647-83e3-e0f354dc2579 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:27.852231 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bac2d2c9-97e4-4647-83e3-e0f354dc2579 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:27.852688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bac2d2c9-97e4-4647-83e3-e0f354dc2579 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:27.853458 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bac2d2c9-97e4-4647-83e3-e0f354dc2579 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:27.853895 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bac2d2c9-97e4-4647-83e3-e0f354dc2579 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:28.117892 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bac2d2c9-97e4-4647-83e3-e0f354dc2579 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:28.133589 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bac2d2c9-97e4-4647-83e3-e0f354dc2579 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1691 microversion: 2.1 time: 0.292757 Jun 16 00:33:28.134452 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 378/780] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:27 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1691 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:28.206700 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-bc717bea-3c92-4e8c-86f0-b85323852220 req-913be089-b17e-49f4-a4af-de0824a33528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5a227f-6658-4f75-9193-65c781e2748f", "name": "network-vif-plugged", "status": "completed", "tag": "c16f9b3b-e924-4296-9815-07d0ab5a729b"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:28.215589 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-bc717bea-3c92-4e8c-86f0-b85323852220 req-913be089-b17e-49f4-a4af-de0824a33528 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:28.216136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-bc717bea-3c92-4e8c-86f0-b85323852220 req-913be089-b17e-49f4-a4af-de0824a33528 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:28.228787 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-bc717bea-3c92-4e8c-86f0-b85323852220 req-913be089-b17e-49f4-a4af-de0824a33528 service nova] Creating event network-vif-plugged:c16f9b3b-e924-4296-9815-07d0ab5a729b for instance 3a5a227f-6658-4f75-9193-65c781e2748f on hv-cinder-84327 Jun 16 00:33:28.234057 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-bc717bea-3c92-4e8c-86f0-b85323852220 req-913be089-b17e-49f4-a4af-de0824a33528 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031128 Jun 16 00:33:28.234735 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 403/781] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:28.266450 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d9feeae6-2a22-450d-a54e-fc8e8ef6e2dd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:28.267456 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d9feeae6-2a22-450d-a54e-fc8e8ef6e2dd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:28.273861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d9feeae6-2a22-450d-a54e-fc8e8ef6e2dd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:28.274316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d9feeae6-2a22-450d-a54e-fc8e8ef6e2dd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:28.275095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d9feeae6-2a22-450d-a54e-fc8e8ef6e2dd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:28.275547 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d9feeae6-2a22-450d-a54e-fc8e8ef6e2dd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:28.447774 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-d9feeae6-2a22-450d-a54e-fc8e8ef6e2dd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:28.455737 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-d9feeae6-2a22-450d-a54e-fc8e8ef6e2dd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:28.457250 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-d9feeae6-2a22-450d-a54e-fc8e8ef6e2dd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:28.458358 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d9feeae6-2a22-450d-a54e-fc8e8ef6e2dd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.195867 Jun 16 00:33:28.458918 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 379/782] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:28 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:29.151432 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-94ae7b9f-1de0-4e85-82dc-5e96099bbb51 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:29.152157 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-94ae7b9f-1de0-4e85-82dc-5e96099bbb51 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:29.159869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-94ae7b9f-1de0-4e85-82dc-5e96099bbb51 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:29.160415 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-94ae7b9f-1de0-4e85-82dc-5e96099bbb51 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:29.161331 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-94ae7b9f-1de0-4e85-82dc-5e96099bbb51 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:29.161768 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-94ae7b9f-1de0-4e85-82dc-5e96099bbb51 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:29.406778 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-94ae7b9f-1de0-4e85-82dc-5e96099bbb51 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:29.416068 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-94ae7b9f-1de0-4e85-82dc-5e96099bbb51 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1691 microversion: 2.1 time: 0.269148 Jun 16 00:33:29.416847 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 404/783] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:29 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1691 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:29.476983 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9d666166-b903-4949-b3bd-0b1663e494d6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:29.477744 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9d666166-b903-4949-b3bd-0b1663e494d6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:29.484544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d666166-b903-4949-b3bd-0b1663e494d6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:29.485007 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d666166-b903-4949-b3bd-0b1663e494d6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:29.485827 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d666166-b903-4949-b3bd-0b1663e494d6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:29.486268 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d666166-b903-4949-b3bd-0b1663e494d6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:29.869568 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9d666166-b903-4949-b3bd-0b1663e494d6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:29.880101 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9d666166-b903-4949-b3bd-0b1663e494d6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:29.881625 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9d666166-b903-4949-b3bd-0b1663e494d6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:29.883241 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9d666166-b903-4949-b3bd-0b1663e494d6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.410398 Jun 16 00:33:29.884246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 380/784] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:29 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:30.432581 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4e5ff3ac-a58a-41de-9ad4-c960f139cbd0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:30.433186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4e5ff3ac-a58a-41de-9ad4-c960f139cbd0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:30.439945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4e5ff3ac-a58a-41de-9ad4-c960f139cbd0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:30.440393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4e5ff3ac-a58a-41de-9ad4-c960f139cbd0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:30.441156 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4e5ff3ac-a58a-41de-9ad4-c960f139cbd0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:30.441714 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4e5ff3ac-a58a-41de-9ad4-c960f139cbd0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:30.665956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4e5ff3ac-a58a-41de-9ad4-c960f139cbd0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:30.674700 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4e5ff3ac-a58a-41de-9ad4-c960f139cbd0 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1691 microversion: 2.1 time: 0.245922 Jun 16 00:33:30.675274 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 405/785] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:30 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1691 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:30.902012 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-90e883ca-a3f3-4f12-9161-91c5fd620bac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:30.902562 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-90e883ca-a3f3-4f12-9161-91c5fd620bac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:30.909781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-90e883ca-a3f3-4f12-9161-91c5fd620bac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:30.910257 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-90e883ca-a3f3-4f12-9161-91c5fd620bac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:30.911039 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-90e883ca-a3f3-4f12-9161-91c5fd620bac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:30.911478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-90e883ca-a3f3-4f12-9161-91c5fd620bac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:31.117811 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-90e883ca-a3f3-4f12-9161-91c5fd620bac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:31.126697 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-90e883ca-a3f3-4f12-9161-91c5fd620bac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:31.128225 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-90e883ca-a3f3-4f12-9161-91c5fd620bac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:31.129338 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-90e883ca-a3f3-4f12-9161-91c5fd620bac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.231344 Jun 16 00:33:31.129898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 381/786] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:30 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:31.692561 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-897b228f-06e7-43c1-a4fd-d1e50b07039d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:31.693114 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-897b228f-06e7-43c1-a4fd-d1e50b07039d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:31.700228 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-897b228f-06e7-43c1-a4fd-d1e50b07039d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:31.700686 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-897b228f-06e7-43c1-a4fd-d1e50b07039d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:31.701488 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-897b228f-06e7-43c1-a4fd-d1e50b07039d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:31.702120 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-897b228f-06e7-43c1-a4fd-d1e50b07039d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:32.004614 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-897b228f-06e7-43c1-a4fd-d1e50b07039d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:32.012658 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-897b228f-06e7-43c1-a4fd-d1e50b07039d tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1691 microversion: 2.1 time: 0.324872 Jun 16 00:33:32.013232 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 406/787] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:31 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1691 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:32.147909 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4d4e2585-ce82-41c3-932e-2e1008d45e1a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:32.149229 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4d4e2585-ce82-41c3-932e-2e1008d45e1a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:32.158408 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4d4e2585-ce82-41c3-932e-2e1008d45e1a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:32.158870 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4d4e2585-ce82-41c3-932e-2e1008d45e1a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:32.159678 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4d4e2585-ce82-41c3-932e-2e1008d45e1a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:32.160380 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4d4e2585-ce82-41c3-932e-2e1008d45e1a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:32.165067 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:32.333828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4d4e2585-ce82-41c3-932e-2e1008d45e1a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:32.343518 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4d4e2585-ce82-41c3-932e-2e1008d45e1a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:32.345701 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4d4e2585-ce82-41c3-932e-2e1008d45e1a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:32.347353 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4d4e2585-ce82-41c3-932e-2e1008d45e1a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1407 microversion: 2.20 time: 0.203486 Jun 16 00:33:32.348039 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 382/788] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:32 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:32.940277 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-2a9fcad1-06ab-46da-967d-840b06c3c5e4 req-d6da2a91-866a-473d-be7a-5a1ad47010f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a2ac88-a177-4fc8-867b-eef87107e914", "name": "network-vif-deleted", "tag": "0e361567-aa2b-46e9-a10e-0d979e26890a"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:32.959151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-2a9fcad1-06ab-46da-967d-840b06c3c5e4 req-d6da2a91-866a-473d-be7a-5a1ad47010f3 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:32.979177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-2a9fcad1-06ab-46da-967d-840b06c3c5e4 req-d6da2a91-866a-473d-be7a-5a1ad47010f3 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:32.997031 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-2a9fcad1-06ab-46da-967d-840b06c3c5e4 req-d6da2a91-866a-473d-be7a-5a1ad47010f3 service nova] Creating event network-vif-deleted:0e361567-aa2b-46e9-a10e-0d979e26890a for instance f4a2ac88-a177-4fc8-867b-eef87107e914 on hv-cinder-84327 Jun 16 00:33:33.004136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-2a9fcad1-06ab-46da-967d-840b06c3c5e4 req-d6da2a91-866a-473d-be7a-5a1ad47010f3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070893 Jun 16 00:33:33.005188 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 407/789] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:33.040787 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-448cf02b-8e9a-4cc2-8843-16462c84b335 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:33.042043 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-448cf02b-8e9a-4cc2-8843-16462c84b335 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:33.051352 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-448cf02b-8e9a-4cc2-8843-16462c84b335 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:33.051988 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-448cf02b-8e9a-4cc2-8843-16462c84b335 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:33.052901 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-448cf02b-8e9a-4cc2-8843-16462c84b335 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:33.053456 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-448cf02b-8e9a-4cc2-8843-16462c84b335 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:33.113793 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-448cf02b-8e9a-4cc2-8843-16462c84b335 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:33.114639 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-448cf02b-8e9a-4cc2-8843-16462c84b335 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:33.115496 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-448cf02b-8e9a-4cc2-8843-16462c84b335 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lazy-loading 'fault' on Instance uuid f4a2ac88-a177-4fc8-867b-eef87107e914 {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:33:33.170686 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-448cf02b-8e9a-4cc2-8843-16462c84b335 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:33.180825 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-448cf02b-8e9a-4cc2-8843-16462c84b335 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 200 len: 1335 microversion: 2.1 time: 0.152123 Jun 16 00:33:33.182295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 383/790] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:33 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 1335 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:33.366562 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-289df66d-9624-49a0-a9a1-7c1d6fb10698 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:33.367662 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-289df66d-9624-49a0-a9a1-7c1d6fb10698 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:33.374412 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-289df66d-9624-49a0-a9a1-7c1d6fb10698 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:33.375150 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-289df66d-9624-49a0-a9a1-7c1d6fb10698 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:33.376733 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-289df66d-9624-49a0-a9a1-7c1d6fb10698 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:33.377331 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-289df66d-9624-49a0-a9a1-7c1d6fb10698 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:33.532712 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-289df66d-9624-49a0-a9a1-7c1d6fb10698 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:33.542485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-289df66d-9624-49a0-a9a1-7c1d6fb10698 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:33.553544 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-289df66d-9624-49a0-a9a1-7c1d6fb10698 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:33.554561 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-289df66d-9624-49a0-a9a1-7c1d6fb10698 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1599 microversion: 2.20 time: 0.192244 Jun 16 00:33:33.555305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 408/791] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:33:33 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1599 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:33:33.584497 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-31f7fff8-bda5-4e27-830e-429a7b25a535 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:33.584668 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-31f7fff8-bda5-4e27-830e-429a7b25a535 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:33.596729 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-31f7fff8-bda5-4e27-830e-429a7b25a535 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:33.597190 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-31f7fff8-bda5-4e27-830e-429a7b25a535 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:33.598260 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-31f7fff8-bda5-4e27-830e-429a7b25a535 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:33.599099 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-31f7fff8-bda5-4e27-830e-429a7b25a535 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:33.696559 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-31f7fff8-bda5-4e27-830e-429a7b25a535 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.122530 Jun 16 00:33:33.704575 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 384/792] 10.222.0.44 () {60 vars in 1315 bytes} [Thu Jun 16 00:33:33 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:33:34.202038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-84a4565c-f9dc-4276-9eb5-8afd51cb3baa tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:34.202759 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-84a4565c-f9dc-4276-9eb5-8afd51cb3baa tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: f4a2ac88-a177-4fc8-867b-eef87107e914] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:34.214354 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-84a4565c-f9dc-4276-9eb5-8afd51cb3baa tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:34.214714 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-84a4565c-f9dc-4276-9eb5-8afd51cb3baa tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:34.215709 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-84a4565c-f9dc-4276-9eb5-8afd51cb3baa tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:34.216832 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-84a4565c-f9dc-4276-9eb5-8afd51cb3baa tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:34.245404 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-84a4565c-f9dc-4276-9eb5-8afd51cb3baa tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] HTTP exception thrown: Instance f4a2ac88-a177-4fc8-867b-eef87107e914 could not be found. Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-84a4565c-f9dc-4276-9eb5-8afd51cb3baa tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Request method failure captured: Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 HTTP/1.1 Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqniiFW-3qlgNwVdz83mtCf1EP3mQusIS9oVM71fN31IAhMvM3vimbmAv9v_7L8qh08N4M0qPQkSSLvw1vueWN6d7oLOTTpqqADq2uYSq6Uqr2TOGUFzua4lWlXwIlOH7P9cN5l04ADufU7_Vn7ZEXu2T4gOY4i-4Tgd3uEbqVYfn_fc Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 3f0f1114473045f899e99736ff9765df Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:33:34.247969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:33:34.249526 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f0f1114473045f899e99736ff9765df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f0f1114473045f899e99736ff9765df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f0f1114473045f899e99736ff9765df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f0f1114473045f899e99736ff9765df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:33:34.249526 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:33:34.249526 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 3f0f1114473045f899e99736ff9765df Jun 16 00:33:34.249526 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:33:34.249526 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-ServerRescueNegativeTestJSON-1499675376-project Jun 16 00:33:34.249526 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:33:34.249526 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:33:34.249526 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: 8a57c3f4e4d7479c9f301195cd9764cc Jun 16 00:33:34.249526 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499675376-project Jun 16 00:33:34.249526 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:33:34.249526 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance f4a2ac88-a177-4fc8-867b-eef87107e914 could not be found. Jun 16 00:33:34.249526 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': 'f4a2ac88-a177-4fc8-867b-eef87107e914'} Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4a2ac88-a177-4fc8-867b-eef87107e914 could not be found. Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:33:34.250659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4a2ac88-a177-4fc8-867b-eef87107e914 could not be found. Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4a2ac88-a177-4fc8-867b-eef87107e914 could not be found. Jun 16 00:33:34.252124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:33:34.254441 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-84a4565c-f9dc-4276-9eb5-8afd51cb3baa tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Returning 404 to user: Instance f4a2ac88-a177-4fc8-867b-eef87107e914 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:33:34.255453 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-84a4565c-f9dc-4276-9eb5-8afd51cb3baa tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914" status: 404 len: 111 microversion: 2.1 time: 0.057258 Jun 16 00:33:34.256177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 409/793] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:34 2022] GET /compute/v2.1/servers/f4a2ac88-a177-4fc8-867b-eef87107e914 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:33:34.265408 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-beb2f425-90e6-4406-be5c-7af2182c87af tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '.version_select at 0x7f95802e7af0>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:34.285302 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-beb2f425-90e6-4406-be5c-7af2182c87af tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-351797934" status: 202 len: 0 microversion: 2.1 time: 0.024344 Jun 16 00:33:34.290371 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 385/794] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jun 16 00:33:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-351797934 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:33:35.227400 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-859b53d1-dd75-4806-92c0-a6031e228e69 req-bf0105b9-7f6f-4460-ad44-a555647e7096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a5a227f-6658-4f75-9193-65c781e2748f", "tag": "c16f9b3b-e924-4296-9815-07d0ab5a729b"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:35.235845 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-859b53d1-dd75-4806-92c0-a6031e228e69 req-bf0105b9-7f6f-4460-ad44-a555647e7096 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:35.236284 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-859b53d1-dd75-4806-92c0-a6031e228e69 req-bf0105b9-7f6f-4460-ad44-a555647e7096 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:35.247845 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-859b53d1-dd75-4806-92c0-a6031e228e69 req-bf0105b9-7f6f-4460-ad44-a555647e7096 service nova] Creating event network-changed:c16f9b3b-e924-4296-9815-07d0ab5a729b for instance 3a5a227f-6658-4f75-9193-65c781e2748f on hv-cinder-84327 Jun 16 00:33:35.253262 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-859b53d1-dd75-4806-92c0-a6031e228e69 req-bf0105b9-7f6f-4460-ad44-a555647e7096 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029494 Jun 16 00:33:35.254051 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 410/795] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:38.014766 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-169c65e9-5201-40f0-b55e-edd0176922d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:38.015275 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-169c65e9-5201-40f0-b55e-edd0176922d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:38.021484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-169c65e9-5201-40f0-b55e-edd0176922d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:38.021950 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-169c65e9-5201-40f0-b55e-edd0176922d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:38.022691 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-169c65e9-5201-40f0-b55e-edd0176922d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:38.023127 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-169c65e9-5201-40f0-b55e-edd0176922d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:38.047730 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-169c65e9-5201-40f0-b55e-edd0176922d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Going to try to terminate instance {{(pid=129465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:33:38.119965 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-169c65e9-5201-40f0-b55e-edd0176922d9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 204 len: 0 microversion: 2.1 time: 0.109104 Jun 16 00:33:38.120462 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 386/796] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:33:38 2022] DELETE /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:33:38.129917 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b2891901-c1ce-49ba-83d3-3b47566907a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:38.130614 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b2891901-c1ce-49ba-83d3-3b47566907a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:38.136868 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b2891901-c1ce-49ba-83d3-3b47566907a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:38.137321 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b2891901-c1ce-49ba-83d3-3b47566907a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:38.138094 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b2891901-c1ce-49ba-83d3-3b47566907a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:38.138534 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b2891901-c1ce-49ba-83d3-3b47566907a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:38.275311 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b2891901-c1ce-49ba-83d3-3b47566907a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:38.283486 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b2891901-c1ce-49ba-83d3-3b47566907a5 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1506 microversion: 2.1 time: 0.157707 Jun 16 00:33:38.284072 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 411/797] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:38 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:39.267245 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-13f167c4-8717-448c-9cae-88c07c02201f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:39.267908 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-13f167c4-8717-448c-9cae-88c07c02201f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:39.275281 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-13f167c4-8717-448c-9cae-88c07c02201f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:39.275759 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-13f167c4-8717-448c-9cae-88c07c02201f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:39.276540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-13f167c4-8717-448c-9cae-88c07c02201f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:39.276973 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-13f167c4-8717-448c-9cae-88c07c02201f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:39.301842 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-13f167c4-8717-448c-9cae-88c07c02201f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lazy-loading 'flavor' on Instance uuid ebb151dc-a559-4ad5-9a4f-c55e2609758f {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:33:39.302089 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-20803320-6d9a-4d72-997a-3d45706f4ed9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:39.302838 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-20803320-6d9a-4d72-997a-3d45706f4ed9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:39.309740 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-20803320-6d9a-4d72-997a-3d45706f4ed9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:39.310328 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-20803320-6d9a-4d72-997a-3d45706f4ed9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:39.311212 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-20803320-6d9a-4d72-997a-3d45706f4ed9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:39.311919 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-20803320-6d9a-4d72-997a-3d45706f4ed9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:39.386522 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-13f167c4-8717-448c-9cae-88c07c02201f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "POST /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f/action" status: 202 len: 0 microversion: 2.1 time: 0.123158 Jun 16 00:33:39.387438 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 387/798] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:33:39 2022] POST /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:33:39.396576 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7b171280-b4b4-4967-8778-7d04a3df31df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:39.398008 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7b171280-b4b4-4967-8778-7d04a3df31df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:39.414151 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7b171280-b4b4-4967-8778-7d04a3df31df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:39.414748 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7b171280-b4b4-4967-8778-7d04a3df31df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:39.416194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7b171280-b4b4-4967-8778-7d04a3df31df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:39.416194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7b171280-b4b4-4967-8778-7d04a3df31df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:39.453508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-20803320-6d9a-4d72-997a-3d45706f4ed9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:39.461887 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-20803320-6d9a-4d72-997a-3d45706f4ed9 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 200 len: 1506 microversion: 2.1 time: 0.165167 Jun 16 00:33:39.462626 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 412/799] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:39 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:39.558151 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7b171280-b4b4-4967-8778-7d04a3df31df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:39.565845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7b171280-b4b4-4967-8778-7d04a3df31df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.173735 Jun 16 00:33:39.566407 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 388/800] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:39 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:39.675131 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-873495f6-6e9d-45dc-a25e-8dae6d570372 req-7f31ee98-973a-410b-83aa-b899b3e1c8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8388df29-a591-4d4c-a77f-530d3f0e4693", "name": "network-vif-deleted", "tag": "d9340f41-2f9e-42a9-aa33-4159ff99dd6b"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:39.683845 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-873495f6-6e9d-45dc-a25e-8dae6d570372 req-7f31ee98-973a-410b-83aa-b899b3e1c8e3 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:39.684576 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-873495f6-6e9d-45dc-a25e-8dae6d570372 req-7f31ee98-973a-410b-83aa-b899b3e1c8e3 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:39.688649 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:39.696382 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-873495f6-6e9d-45dc-a25e-8dae6d570372 req-7f31ee98-973a-410b-83aa-b899b3e1c8e3 service nova] Creating event network-vif-deleted:d9340f41-2f9e-42a9-aa33-4159ff99dd6b for instance 8388df29-a591-4d4c-a77f-530d3f0e4693 on hv-cinder-84327 Jun 16 00:33:39.701452 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-873495f6-6e9d-45dc-a25e-8dae6d570372 req-7f31ee98-973a-410b-83aa-b899b3e1c8e3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030773 Jun 16 00:33:39.702390 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 413/801] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:40.479581 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-59aa5181-0877-4332-87ac-54c31eaac65c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:40.480249 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-59aa5181-0877-4332-87ac-54c31eaac65c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: 8388df29-a591-4d4c-a77f-530d3f0e4693] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:40.486725 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-59aa5181-0877-4332-87ac-54c31eaac65c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:40.487174 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-59aa5181-0877-4332-87ac-54c31eaac65c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:40.487973 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-59aa5181-0877-4332-87ac-54c31eaac65c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:40.488417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-59aa5181-0877-4332-87ac-54c31eaac65c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:40.501840 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-59aa5181-0877-4332-87ac-54c31eaac65c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] HTTP exception thrown: Instance 8388df29-a591-4d4c-a77f-530d3f0e4693 could not be found. Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-59aa5181-0877-4332-87ac-54c31eaac65c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Request method failure captured: Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 HTTP/1.1 Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqniiFW-3qlgNwVdz83mtCf1EP3mQusIS9oVM71fN31IAhMvM3vimbmAv9v_7L8qh08N4M0qPQkSSLvw1vueWN6d7oLOTTpqqADq2uYSq6Uqr2TOGUFzua4lWlXwIlOH7P9cN5l04ADufU7_Vn7ZEXu2T4gOY4i-4Tgd3uEbqVYfn_fc Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 3f0f1114473045f899e99736ff9765df Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:33:40.503469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:33:40.505178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f0f1114473045f899e99736ff9765df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f0f1114473045f899e99736ff9765df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f0f1114473045f899e99736ff9765df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f0f1114473045f899e99736ff9765df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:33:40.505178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:33:40.505178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 3f0f1114473045f899e99736ff9765df Jun 16 00:33:40.505178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:33:40.505178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-ServerRescueNegativeTestJSON-1499675376-project Jun 16 00:33:40.505178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:33:40.505178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:33:40.505178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: 8a57c3f4e4d7479c9f301195cd9764cc Jun 16 00:33:40.505178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499675376-project Jun 16 00:33:40.505178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:33:40.505178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 8388df29-a591-4d4c-a77f-530d3f0e4693 could not be found. Jun 16 00:33:40.505178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '8388df29-a591-4d4c-a77f-530d3f0e4693'} Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8388df29-a591-4d4c-a77f-530d3f0e4693 could not be found. Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:33:40.506094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8388df29-a591-4d4c-a77f-530d3f0e4693 could not be found. Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8388df29-a591-4d4c-a77f-530d3f0e4693 could not be found. Jun 16 00:33:40.507318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:33:40.508467 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-59aa5181-0877-4332-87ac-54c31eaac65c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Returning 404 to user: Instance 8388df29-a591-4d4c-a77f-530d3f0e4693 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:33:40.508467 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-59aa5181-0877-4332-87ac-54c31eaac65c tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693" status: 404 len: 111 microversion: 2.1 time: 0.029225 Jun 16 00:33:40.508467 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 389/802] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:40 2022] GET /compute/v2.1/servers/8388df29-a591-4d4c-a77f-530d3f0e4693 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:33:40.514632 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d20f70b1-0e74-41f7-b05b-63bfdcf46b57 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:40.515216 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d20f70b1-0e74-41f7-b05b-63bfdcf46b57 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:40.522363 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d20f70b1-0e74-41f7-b05b-63bfdcf46b57 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:40.522815 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d20f70b1-0e74-41f7-b05b-63bfdcf46b57 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:40.523665 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d20f70b1-0e74-41f7-b05b-63bfdcf46b57 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:40.524073 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d20f70b1-0e74-41f7-b05b-63bfdcf46b57 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:40.548667 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d20f70b1-0e74-41f7-b05b-63bfdcf46b57 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Going to try to terminate instance {{(pid=129466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:33:40.582164 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9d935c77-5d63-4a95-999c-f876b598ba67 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:40.582882 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9d935c77-5d63-4a95-999c-f876b598ba67 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:40.589101 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d935c77-5d63-4a95-999c-f876b598ba67 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:40.589556 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d935c77-5d63-4a95-999c-f876b598ba67 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:40.590319 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d935c77-5d63-4a95-999c-f876b598ba67 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:40.590771 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9d935c77-5d63-4a95-999c-f876b598ba67 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:40.629287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d20f70b1-0e74-41f7-b05b-63bfdcf46b57 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 204 len: 0 microversion: 2.1 time: 0.119267 Jun 16 00:33:40.630242 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 414/803] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:33:40 2022] DELETE /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:33:40.638173 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8cf5212b-b375-4847-9201-4582121ac037 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:40.638873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8cf5212b-b375-4847-9201-4582121ac037 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:40.645645 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8cf5212b-b375-4847-9201-4582121ac037 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:40.646093 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8cf5212b-b375-4847-9201-4582121ac037 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:40.646871 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8cf5212b-b375-4847-9201-4582121ac037 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:40.647312 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8cf5212b-b375-4847-9201-4582121ac037 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:40.765158 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9d935c77-5d63-4a95-999c-f876b598ba67 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:40.773386 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9d935c77-5d63-4a95-999c-f876b598ba67 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.195069 Jun 16 00:33:40.774044 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 390/804] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:40 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:40.815012 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8cf5212b-b375-4847-9201-4582121ac037 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:40.822420 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8cf5212b-b375-4847-9201-4582121ac037 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.188262 Jun 16 00:33:40.822976 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 415/805] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:40 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:41.791670 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-60871fec-0fe5-49b2-b88f-9c11c212c1df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:41.792198 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-60871fec-0fe5-49b2-b88f-9c11c212c1df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:41.799489 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60871fec-0fe5-49b2-b88f-9c11c212c1df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:41.800266 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60871fec-0fe5-49b2-b88f-9c11c212c1df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:41.801267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60871fec-0fe5-49b2-b88f-9c11c212c1df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:41.801722 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60871fec-0fe5-49b2-b88f-9c11c212c1df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:41.839406 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f4e9661b-bb44-4acc-9deb-977d17f30913 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:41.840074 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f4e9661b-bb44-4acc-9deb-977d17f30913 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:41.846631 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4e9661b-bb44-4acc-9deb-977d17f30913 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:41.847171 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4e9661b-bb44-4acc-9deb-977d17f30913 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:41.848051 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4e9661b-bb44-4acc-9deb-977d17f30913 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:41.848732 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4e9661b-bb44-4acc-9deb-977d17f30913 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:41.985752 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-60871fec-0fe5-49b2-b88f-9c11c212c1df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:41.994518 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-60871fec-0fe5-49b2-b88f-9c11c212c1df tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.206815 Jun 16 00:33:41.995313 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 391/806] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:41 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:42.036896 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f4e9661b-bb44-4acc-9deb-977d17f30913 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a57c3f4e4d7479c9f301195cd9764cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0f1114473045f899e99736ff9765df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:42.044786 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f4e9661b-bb44-4acc-9deb-977d17f30913 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 200 len: 1523 microversion: 2.1 time: 0.209208 Jun 16 00:33:42.053067 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 416/807] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:41 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:42.070787 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-6d902110-8145-4e6f-b4c6-50d5d9e0f50f req-44a1dfbc-5aff-45ea-859f-626953634ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4", "name": "network-vif-deleted", "tag": "bd914ca3-f036-4016-bdf2-f6dffc6a5655"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:42.084834 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-6d902110-8145-4e6f-b4c6-50d5d9e0f50f req-44a1dfbc-5aff-45ea-859f-626953634ac9 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:42.085273 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-6d902110-8145-4e6f-b4c6-50d5d9e0f50f req-44a1dfbc-5aff-45ea-859f-626953634ac9 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:42.098142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-6d902110-8145-4e6f-b4c6-50d5d9e0f50f req-44a1dfbc-5aff-45ea-859f-626953634ac9 service nova] Creating event network-vif-deleted:bd914ca3-f036-4016-bdf2-f6dffc6a5655 for instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 on hv-cinder-84327 Jun 16 00:33:42.106546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-6d902110-8145-4e6f-b4c6-50d5d9e0f50f req-44a1dfbc-5aff-45ea-859f-626953634ac9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038971 Jun 16 00:33:42.107157 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 392/808] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:43.012461 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7eca0d97-201c-49e5-b07e-8a6a90cf1d79 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:43.013065 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7eca0d97-201c-49e5-b07e-8a6a90cf1d79 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:43.019936 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7eca0d97-201c-49e5-b07e-8a6a90cf1d79 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:43.020382 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7eca0d97-201c-49e5-b07e-8a6a90cf1d79 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:43.021133 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7eca0d97-201c-49e5-b07e-8a6a90cf1d79 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:43.021563 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7eca0d97-201c-49e5-b07e-8a6a90cf1d79 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:43.062597 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5edcd65a-3898-4101-b175-c9b9e13ddcd1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:43.063373 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5edcd65a-3898-4101-b175-c9b9e13ddcd1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] [instance: c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:43.070082 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5edcd65a-3898-4101-b175-c9b9e13ddcd1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:43.070524 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5edcd65a-3898-4101-b175-c9b9e13ddcd1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:43.071293 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5edcd65a-3898-4101-b175-c9b9e13ddcd1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:43.071755 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5edcd65a-3898-4101-b175-c9b9e13ddcd1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:43.085183 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-5edcd65a-3898-4101-b175-c9b9e13ddcd1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] HTTP exception thrown: Instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 could not be found. Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5edcd65a-3898-4101-b175-c9b9e13ddcd1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Request method failure captured: Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 HTTP/1.1 Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqniiFW-3qlgNwVdz83mtCf1EP3mQusIS9oVM71fN31IAhMvM3vimbmAv9v_7L8qh08N4M0qPQkSSLvw1vueWN6d7oLOTTpqqADq2uYSq6Uqr2TOGUFzua4lWlXwIlOH7P9cN5l04ADufU7_Vn7ZEXu2T4gOY4i-4Tgd3uEbqVYfn_fc Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 3f0f1114473045f899e99736ff9765df Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:33:43.086829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:33:43.088431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f0f1114473045f899e99736ff9765df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f0f1114473045f899e99736ff9765df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f0f1114473045f899e99736ff9765df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f0f1114473045f899e99736ff9765df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:33:43.088431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:33:43.088431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 3f0f1114473045f899e99736ff9765df Jun 16 00:33:43.088431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1499675376 Jun 16 00:33:43.088431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-ServerRescueNegativeTestJSON-1499675376-project Jun 16 00:33:43.088431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:33:43.088431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:33:43.088431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: 8a57c3f4e4d7479c9f301195cd9764cc Jun 16 00:33:43.088431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1499675376-project Jun 16 00:33:43.088431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:33:43.088431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 could not be found. Jun 16 00:33:43.088431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': 'c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4'} Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 could not be found. Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:33:43.089297 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 could not be found. Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 could not be found. Jun 16 00:33:43.090540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:33:43.091629 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5edcd65a-3898-4101-b175-c9b9e13ddcd1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] Returning 404 to user: Instance c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:33:43.091629 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5edcd65a-3898-4101-b175-c9b9e13ddcd1 tempest-ServerRescueNegativeTestJSON-1499675376 tempest-ServerRescueNegativeTestJSON-1499675376-project] 10.222.0.44 "GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4" status: 404 len: 111 microversion: 2.1 time: 0.029927 Jun 16 00:33:43.091629 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 393/809] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:43 2022] GET /compute/v2.1/servers/c9ae12b4-b8d8-4ff5-a54a-8e805672e9f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:33:43.154505 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7eca0d97-201c-49e5-b07e-8a6a90cf1d79 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:43.161928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7eca0d97-201c-49e5-b07e-8a6a90cf1d79 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.153373 Jun 16 00:33:43.162487 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 417/810] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:43 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:44.179411 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-33400b84-96bb-4bee-8896-3bd3b77e6cbd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:44.180097 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-33400b84-96bb-4bee-8896-3bd3b77e6cbd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:44.186675 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-33400b84-96bb-4bee-8896-3bd3b77e6cbd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:44.187245 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-33400b84-96bb-4bee-8896-3bd3b77e6cbd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:44.188164 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-33400b84-96bb-4bee-8896-3bd3b77e6cbd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:44.188646 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-33400b84-96bb-4bee-8896-3bd3b77e6cbd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:44.328920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-33400b84-96bb-4bee-8896-3bd3b77e6cbd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:44.337901 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-33400b84-96bb-4bee-8896-3bd3b77e6cbd tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.162230 Jun 16 00:33:44.338787 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 394/811] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:44 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:45.355943 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-77a95836-b6db-4e49-962b-5551d74d9b57 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:45.356575 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-77a95836-b6db-4e49-962b-5551d74d9b57 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:45.359191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:45.365024 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-77a95836-b6db-4e49-962b-5551d74d9b57 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:45.365529 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-77a95836-b6db-4e49-962b-5551d74d9b57 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:45.366250 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-77a95836-b6db-4e49-962b-5551d74d9b57 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:45.366692 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-77a95836-b6db-4e49-962b-5551d74d9b57 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:45.504478 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-77a95836-b6db-4e49-962b-5551d74d9b57 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:45.512275 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-77a95836-b6db-4e49-962b-5551d74d9b57 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.160413 Jun 16 00:33:45.513028 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 418/812] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:45 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:46.531482 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3d282b28-87ab-4a23-bc01-d76645cd81c1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:46.532233 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3d282b28-87ab-4a23-bc01-d76645cd81c1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:46.539108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3d282b28-87ab-4a23-bc01-d76645cd81c1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:46.539550 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3d282b28-87ab-4a23-bc01-d76645cd81c1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:46.540331 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3d282b28-87ab-4a23-bc01-d76645cd81c1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:46.540762 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3d282b28-87ab-4a23-bc01-d76645cd81c1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:46.673682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3d282b28-87ab-4a23-bc01-d76645cd81c1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:46.681387 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3d282b28-87ab-4a23-bc01-d76645cd81c1 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.156119 Jun 16 00:33:46.682058 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 395/813] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:46 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:47.698353 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9e452ffe-2db3-463b-bcfc-635be4d91236 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:47.698955 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9e452ffe-2db3-463b-bcfc-635be4d91236 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:47.706697 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9e452ffe-2db3-463b-bcfc-635be4d91236 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:47.707152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9e452ffe-2db3-463b-bcfc-635be4d91236 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:47.707988 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9e452ffe-2db3-463b-bcfc-635be4d91236 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:47.708432 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9e452ffe-2db3-463b-bcfc-635be4d91236 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:47.887601 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-9e452ffe-2db3-463b-bcfc-635be4d91236 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:47.896449 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9e452ffe-2db3-463b-bcfc-635be4d91236 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.201917 Jun 16 00:33:47.897022 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 419/814] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:47 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:48.913881 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7defe6f8-a066-4301-8403-e13423e1c88b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:48.914494 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7defe6f8-a066-4301-8403-e13423e1c88b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:48.921735 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7defe6f8-a066-4301-8403-e13423e1c88b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:48.922188 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7defe6f8-a066-4301-8403-e13423e1c88b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:48.923508 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7defe6f8-a066-4301-8403-e13423e1c88b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:48.923974 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7defe6f8-a066-4301-8403-e13423e1c88b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:49.069352 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7defe6f8-a066-4301-8403-e13423e1c88b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:49.076938 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7defe6f8-a066-4301-8403-e13423e1c88b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.167225 Jun 16 00:33:49.077614 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 396/815] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:48 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:50.094784 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e050078a-4bc7-4ed6-bf84-67726bcb85b4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:50.096175 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e050078a-4bc7-4ed6-bf84-67726bcb85b4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:50.112605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e050078a-4bc7-4ed6-bf84-67726bcb85b4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:50.113714 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e050078a-4bc7-4ed6-bf84-67726bcb85b4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:50.115193 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e050078a-4bc7-4ed6-bf84-67726bcb85b4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:50.116011 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e050078a-4bc7-4ed6-bf84-67726bcb85b4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:50.315248 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e050078a-4bc7-4ed6-bf84-67726bcb85b4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:50.322926 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e050078a-4bc7-4ed6-bf84-67726bcb85b4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.232316 Jun 16 00:33:50.323762 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 420/816] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:50 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:51.340192 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1502b3b0-bcaf-44a7-a44a-02d3457fd2bc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:51.340796 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1502b3b0-bcaf-44a7-a44a-02d3457fd2bc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:51.359659 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:51.364970 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1502b3b0-bcaf-44a7-a44a-02d3457fd2bc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:51.364970 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1502b3b0-bcaf-44a7-a44a-02d3457fd2bc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:51.365729 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1502b3b0-bcaf-44a7-a44a-02d3457fd2bc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:51.366161 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1502b3b0-bcaf-44a7-a44a-02d3457fd2bc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:51.538443 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1502b3b0-bcaf-44a7-a44a-02d3457fd2bc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:51.551166 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1502b3b0-bcaf-44a7-a44a-02d3457fd2bc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.214097 Jun 16 00:33:51.561359 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 397/817] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:51 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:51.953685 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c4a49e43-2f30-4dd0-bf4b-981305201a3f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Action: 'create', calling method: .version_select at 0x7f9573bdf790>, body: {"keypair": {"name": "tempest-keypair-331333114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmUXGbxgaNG2gLGLEBKx+igrUXSwR4rPhe1TOxlmVva5SzN9Q03Cm8ZlnBYp3DW6aKWIIvmP4OdNrldPZxgi9daNQYoWdtShoHV4AvBe4PsLG5ECUCg2E6x9gkBsYoBvw=="}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:51.968238 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-c4a49e43-2f30-4dd0-bf4b-981305201a3f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Getting quotas for project 985ab6e44f6d4425a2def9b3a52262d8. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:33:51.972484 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-c4a49e43-2f30-4dd0-bf4b-981305201a3f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Getting quotas for user 9e3855abd7ea410fa64d546b3a85ff31 and project 985ab6e44f6d4425a2def9b3a52262d8. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:33:51.995285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c4a49e43-2f30-4dd0-bf4b-981305201a3f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.175577 Jun 16 00:33:51.996102 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 421/818] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 16 00:33:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:52.570792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b2632cfe-bcdb-4a15-82b1-582c180adcc2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:52.573776 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b2632cfe-bcdb-4a15-82b1-582c180adcc2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:52.581959 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b2632cfe-bcdb-4a15-82b1-582c180adcc2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:52.582412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b2632cfe-bcdb-4a15-82b1-582c180adcc2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:52.583374 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b2632cfe-bcdb-4a15-82b1-582c180adcc2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:52.584011 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b2632cfe-bcdb-4a15-82b1-582c180adcc2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:52.588370 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:52.732881 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b2632cfe-bcdb-4a15-82b1-582c180adcc2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:52.741369 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b2632cfe-bcdb-4a15-82b1-582c180adcc2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.174485 Jun 16 00:33:52.742286 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 398/819] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:52 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:53.339724 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-618094185", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "059c3639-6ef4-446d-b198-5b0d90caf651"}], "security_groups": [{"name": "tempest-securitygroup--1141729630"}], "key_name": "tempest-keypair-331333114", "user_data": "}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:53.463689 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.network.neutron [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] validate_networks() for [('059c3639-6ef4-446d-b198-5b0d90caf651', None, None, None, None, None)] {{(pid=129466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:33:53.759962 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-92db0e7e-9513-4f96-9259-a956fd4b2c4c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:53.761444 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-92db0e7e-9513-4f96-9259-a956fd4b2c4c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:53.770389 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-92db0e7e-9513-4f96-9259-a956fd4b2c4c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:53.771930 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-92db0e7e-9513-4f96-9259-a956fd4b2c4c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:53.773009 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-92db0e7e-9513-4f96-9259-a956fd4b2c4c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:53.773600 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-92db0e7e-9513-4f96-9259-a956fd4b2c4c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:53.959762 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Flavor limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:33:53.960594 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Image limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:33:53.961183 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Flavor pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:33:53.961826 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Image pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:33:53.962444 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:33:53.977700 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:53.978385 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:53.979386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:53.980015 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:54.023564 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Getting quotas for project 985ab6e44f6d4425a2def9b3a52262d8. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:33:54.031574 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Getting quotas for user 9e3855abd7ea410fa64d546b3a85ff31 and project 985ab6e44f6d4425a2def9b3a52262d8. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:33:54.047546 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Going to run 1 instances... {{(pid=129466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:33:54.050911 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:33:54.071812 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-92db0e7e-9513-4f96-9259-a956fd4b2c4c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:54.082331 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-92db0e7e-9513-4f96-9259-a956fd4b2c4c tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1507 microversion: 2.1 time: 0.327106 Jun 16 00:33:54.095851 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 399/820] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:53 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1507 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:54.101418 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0a4a2e81-0c2c-41ad-afd3-e2a8f2008605 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:54.102273 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0a4a2e81-0c2c-41ad-afd3-e2a8f2008605 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:54.111353 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a4a2e81-0c2c-41ad-afd3-e2a8f2008605 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:54.112056 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a4a2e81-0c2c-41ad-afd3-e2a8f2008605 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:54.113140 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a4a2e81-0c2c-41ad-afd3-e2a8f2008605 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:54.113736 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0a4a2e81-0c2c-41ad-afd3-e2a8f2008605 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:54.129895 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-9dee9ef2-6dac-410c-a15e-b280624f5e59 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.794297 Jun 16 00:33:54.133504 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 422/821] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:33:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:33:54.149626 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b2127862-8844-4a12-8ffa-48333d36c9f8 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:54.151649 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b2127862-8844-4a12-8ffa-48333d36c9f8 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:54.234833 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0a4a2e81-0c2c-41ad-afd3-e2a8f2008605 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "POST /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f/action" status: 202 len: 0 microversion: 2.1 time: 0.137390 Jun 16 00:33:54.242035 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 400/822] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:33:54 2022] POST /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:33:54.262435 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8ab53921-afed-403e-bfa7-661c31f4ec50 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:54.263771 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8ab53921-afed-403e-bfa7-661c31f4ec50 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:54.295913 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8ab53921-afed-403e-bfa7-661c31f4ec50 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:54.296501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8ab53921-afed-403e-bfa7-661c31f4ec50 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:54.297527 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8ab53921-afed-403e-bfa7-661c31f4ec50 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:54.298120 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8ab53921-afed-403e-bfa7-661c31f4ec50 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:54.320830 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b2127862-8844-4a12-8ffa-48333d36c9f8 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:54.334930 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b2127862-8844-4a12-8ffa-48333d36c9f8 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1236 microversion: 2.1 time: 0.196277 Jun 16 00:33:54.347425 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 423/823] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:54 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1236 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:33:54.524782 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8ab53921-afed-403e-bfa7-661c31f4ec50 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:54.533000 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8ab53921-afed-403e-bfa7-661c31f4ec50 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1515 microversion: 2.1 time: 0.289959 Jun 16 00:33:54.533570 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 401/824] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:54 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1515 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:55.352910 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f28d94f5-8ef2-481b-bf41-436bf37a6cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:55.353638 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f28d94f5-8ef2-481b-bf41-436bf37a6cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:55.360528 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f28d94f5-8ef2-481b-bf41-436bf37a6cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:55.361048 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f28d94f5-8ef2-481b-bf41-436bf37a6cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:55.361947 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f28d94f5-8ef2-481b-bf41-436bf37a6cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:55.362451 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f28d94f5-8ef2-481b-bf41-436bf37a6cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:55.429934 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f28d94f5-8ef2-481b-bf41-436bf37a6cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:55.437865 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f28d94f5-8ef2-481b-bf41-436bf37a6cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1288 microversion: 2.1 time: 0.090143 Jun 16 00:33:55.438951 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 424/825] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:55 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:55.554162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-458b1d36-3c7d-4b63-abb7-81a0c82c5513 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:55.556244 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-458b1d36-3c7d-4b63-abb7-81a0c82c5513 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:55.565806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-458b1d36-3c7d-4b63-abb7-81a0c82c5513 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:55.566260 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-458b1d36-3c7d-4b63-abb7-81a0c82c5513 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:55.567043 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-458b1d36-3c7d-4b63-abb7-81a0c82c5513 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:55.567488 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-458b1d36-3c7d-4b63-abb7-81a0c82c5513 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:55.708294 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-458b1d36-3c7d-4b63-abb7-81a0c82c5513 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:55.715937 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-458b1d36-3c7d-4b63-abb7-81a0c82c5513 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1517 microversion: 2.1 time: 0.169216 Jun 16 00:33:55.716494 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 402/826] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:55 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:56.320615 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-dcd3cd88-bbbb-4a1c-897d-44240a37caa6 req-e4db001b-27b3-48c6-860a-78cf6787170a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb151dc-a559-4ad5-9a4f-c55e2609758f", "name": "network-vif-unplugged", "status": "completed", "tag": "bf8752fe-370d-4c67-8d58-5ab0ba31fdc9"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:56.332334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-dcd3cd88-bbbb-4a1c-897d-44240a37caa6 req-e4db001b-27b3-48c6-860a-78cf6787170a service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:56.336058 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-dcd3cd88-bbbb-4a1c-897d-44240a37caa6 req-e4db001b-27b3-48c6-860a-78cf6787170a service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:56.360522 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-dcd3cd88-bbbb-4a1c-897d-44240a37caa6 req-e4db001b-27b3-48c6-860a-78cf6787170a service nova] Creating event network-vif-unplugged:bf8752fe-370d-4c67-8d58-5ab0ba31fdc9 for instance ebb151dc-a559-4ad5-9a4f-c55e2609758f on hv-cinder-84327 Jun 16 00:33:56.367694 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-dcd3cd88-bbbb-4a1c-897d-44240a37caa6 req-e4db001b-27b3-48c6-860a-78cf6787170a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050779 Jun 16 00:33:56.368524 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 425/827] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:56.455461 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8b2eeb43-4be1-4e86-bb05-4c54f9f043e6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:56.456098 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8b2eeb43-4be1-4e86-bb05-4c54f9f043e6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:56.462635 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8b2eeb43-4be1-4e86-bb05-4c54f9f043e6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:56.463097 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8b2eeb43-4be1-4e86-bb05-4c54f9f043e6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:56.463913 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8b2eeb43-4be1-4e86-bb05-4c54f9f043e6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:56.464356 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8b2eeb43-4be1-4e86-bb05-4c54f9f043e6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:56.688499 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8b2eeb43-4be1-4e86-bb05-4c54f9f043e6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:56.697537 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8b2eeb43-4be1-4e86-bb05-4c54f9f043e6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1362 microversion: 2.1 time: 0.246370 Jun 16 00:33:56.698336 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 403/828] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:56 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:56.734109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ddf1eda4-3900-4802-a93e-6cbb04732b43 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:56.734807 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ddf1eda4-3900-4802-a93e-6cbb04732b43 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:56.741774 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ddf1eda4-3900-4802-a93e-6cbb04732b43 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:56.742226 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ddf1eda4-3900-4802-a93e-6cbb04732b43 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:56.742996 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ddf1eda4-3900-4802-a93e-6cbb04732b43 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:56.743431 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ddf1eda4-3900-4802-a93e-6cbb04732b43 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:56.961719 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ddf1eda4-3900-4802-a93e-6cbb04732b43 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:56.969825 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ddf1eda4-3900-4802-a93e-6cbb04732b43 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1573 microversion: 2.1 time: 0.239920 Jun 16 00:33:56.970395 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 426/829] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:56 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1573 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:57.081270 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-2e03ce42-848b-47d8-8069-a39cdc54d6da req-f9d00db6-4233-4e29-a2b8-2c653f83e66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f39b67-fe8c-4a0a-8ac8-ca589391af83", "tag": "2a8ee73b-38ca-40d3-b4f0-c1b095af5c9e"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:33:57.090552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-2e03ce42-848b-47d8-8069-a39cdc54d6da req-f9d00db6-4233-4e29-a2b8-2c653f83e66b service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:57.091042 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-2e03ce42-848b-47d8-8069-a39cdc54d6da req-f9d00db6-4233-4e29-a2b8-2c653f83e66b service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:57.105489 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-2e03ce42-848b-47d8-8069-a39cdc54d6da req-f9d00db6-4233-4e29-a2b8-2c653f83e66b service nova] Creating event network-changed:2a8ee73b-38ca-40d3-b4f0-c1b095af5c9e for instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 on hv-cinder-84327 Jun 16 00:33:57.112633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-2e03ce42-848b-47d8-8069-a39cdc54d6da req-f9d00db6-4233-4e29-a2b8-2c653f83e66b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036783 Jun 16 00:33:57.125027 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 404/830] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:33:57.714120 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2c2cc5a1-69e9-4299-9215-903202fd9812 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:57.714724 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2c2cc5a1-69e9-4299-9215-903202fd9812 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:57.721645 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2c2cc5a1-69e9-4299-9215-903202fd9812 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:57.722094 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2c2cc5a1-69e9-4299-9215-903202fd9812 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:57.722856 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2c2cc5a1-69e9-4299-9215-903202fd9812 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:57.723285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2c2cc5a1-69e9-4299-9215-903202fd9812 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:57.849503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2c2cc5a1-69e9-4299-9215-903202fd9812 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:57.856880 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2c2cc5a1-69e9-4299-9215-903202fd9812 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1362 microversion: 2.1 time: 0.146574 Jun 16 00:33:57.857428 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 427/831] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:57 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:57.987089 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-20a69d0c-d0e7-46e4-ab2b-0248344b5d44 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:57.987751 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-20a69d0c-d0e7-46e4-ab2b-0248344b5d44 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:57.994358 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-20a69d0c-d0e7-46e4-ab2b-0248344b5d44 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:57.994807 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-20a69d0c-d0e7-46e4-ab2b-0248344b5d44 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:57.995570 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-20a69d0c-d0e7-46e4-ab2b-0248344b5d44 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:57.996034 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-20a69d0c-d0e7-46e4-ab2b-0248344b5d44 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:58.127299 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-20a69d0c-d0e7-46e4-ab2b-0248344b5d44 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:58.134725 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-20a69d0c-d0e7-46e4-ab2b-0248344b5d44 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1573 microversion: 2.1 time: 0.151860 Jun 16 00:33:58.135281 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 405/832] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:57 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:58.873592 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-91de2f15-17e3-4f02-b603-a874019313df tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:58.874194 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-91de2f15-17e3-4f02-b603-a874019313df tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:58.881378 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-91de2f15-17e3-4f02-b603-a874019313df tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:58.881822 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-91de2f15-17e3-4f02-b603-a874019313df tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:58.882579 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-91de2f15-17e3-4f02-b603-a874019313df tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:58.883012 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-91de2f15-17e3-4f02-b603-a874019313df tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:59.006110 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-91de2f15-17e3-4f02-b603-a874019313df tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:59.013402 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-91de2f15-17e3-4f02-b603-a874019313df tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1362 microversion: 2.1 time: 0.143660 Jun 16 00:33:59.013962 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 428/833] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:58 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:33:59.152355 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-51a341e1-da66-4101-964a-c2208f027f9d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:33:59.152890 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-51a341e1-da66-4101-964a-c2208f027f9d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:33:59.159830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-51a341e1-da66-4101-964a-c2208f027f9d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:59.160274 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-51a341e1-da66-4101-964a-c2208f027f9d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:59.161027 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-51a341e1-da66-4101-964a-c2208f027f9d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:59.161456 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-51a341e1-da66-4101-964a-c2208f027f9d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:59.287803 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-51a341e1-da66-4101-964a-c2208f027f9d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:33:59.295255 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-51a341e1-da66-4101-964a-c2208f027f9d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1573 microversion: 2.1 time: 0.146716 Jun 16 00:33:59.295848 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 406/834] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:33:59 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1573 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:00.029352 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a6123eac-8701-4dd8-8630-1bd5582f4594 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:00.029956 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a6123eac-8701-4dd8-8630-1bd5582f4594 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:00.036492 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a6123eac-8701-4dd8-8630-1bd5582f4594 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:00.036941 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a6123eac-8701-4dd8-8630-1bd5582f4594 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:00.037699 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a6123eac-8701-4dd8-8630-1bd5582f4594 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:00.038160 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a6123eac-8701-4dd8-8630-1bd5582f4594 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:00.167325 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a6123eac-8701-4dd8-8630-1bd5582f4594 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:00.175208 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a6123eac-8701-4dd8-8630-1bd5582f4594 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1362 microversion: 2.1 time: 0.149670 Jun 16 00:34:00.175817 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 429/835] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:00 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:00.312043 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c08dd5fc-9be1-4f83-823d-a74b3bbc2629 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:00.312674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c08dd5fc-9be1-4f83-823d-a74b3bbc2629 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:00.319773 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c08dd5fc-9be1-4f83-823d-a74b3bbc2629 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:00.320220 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c08dd5fc-9be1-4f83-823d-a74b3bbc2629 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:00.320976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c08dd5fc-9be1-4f83-823d-a74b3bbc2629 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:00.321406 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c08dd5fc-9be1-4f83-823d-a74b3bbc2629 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:00.448602 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c08dd5fc-9be1-4f83-823d-a74b3bbc2629 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:00.455932 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c08dd5fc-9be1-4f83-823d-a74b3bbc2629 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1573 microversion: 2.1 time: 0.147668 Jun 16 00:34:00.456588 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 407/836] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:00 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:01.192370 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d91c8044-4a29-4d36-bd0f-b954fbe74895 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:01.193060 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d91c8044-4a29-4d36-bd0f-b954fbe74895 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:01.199667 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d91c8044-4a29-4d36-bd0f-b954fbe74895 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:01.200122 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d91c8044-4a29-4d36-bd0f-b954fbe74895 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:01.200889 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d91c8044-4a29-4d36-bd0f-b954fbe74895 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:01.201324 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d91c8044-4a29-4d36-bd0f-b954fbe74895 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:01.332516 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d91c8044-4a29-4d36-bd0f-b954fbe74895 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:01.339973 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d91c8044-4a29-4d36-bd0f-b954fbe74895 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1362 microversion: 2.1 time: 0.152044 Jun 16 00:34:01.340534 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 430/837] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:01 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:01.472737 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5faba4e6-cb99-4118-9d01-61da0b9bbbf9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:01.473425 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5faba4e6-cb99-4118-9d01-61da0b9bbbf9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:01.480042 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5faba4e6-cb99-4118-9d01-61da0b9bbbf9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:01.480500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5faba4e6-cb99-4118-9d01-61da0b9bbbf9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:01.481273 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5faba4e6-cb99-4118-9d01-61da0b9bbbf9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:01.481708 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5faba4e6-cb99-4118-9d01-61da0b9bbbf9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:01.608888 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5faba4e6-cb99-4118-9d01-61da0b9bbbf9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:01.616745 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5faba4e6-cb99-4118-9d01-61da0b9bbbf9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1573 microversion: 2.1 time: 0.147818 Jun 16 00:34:01.617298 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 408/838] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:01 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:02.356682 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c0e48920-a416-4152-b514-e53ca0c961fc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:02.357389 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c0e48920-a416-4152-b514-e53ca0c961fc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:02.364734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c0e48920-a416-4152-b514-e53ca0c961fc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:02.365189 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c0e48920-a416-4152-b514-e53ca0c961fc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:02.366003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c0e48920-a416-4152-b514-e53ca0c961fc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:02.366443 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c0e48920-a416-4152-b514-e53ca0c961fc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:02.494151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c0e48920-a416-4152-b514-e53ca0c961fc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:02.502302 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c0e48920-a416-4152-b514-e53ca0c961fc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1362 microversion: 2.1 time: 0.149510 Jun 16 00:34:02.502865 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 431/839] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:02 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:02.633209 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-edab51af-2ee2-48b2-ac42-8142bb6613fe tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:02.633812 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-edab51af-2ee2-48b2-ac42-8142bb6613fe tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:02.640329 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-edab51af-2ee2-48b2-ac42-8142bb6613fe tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:02.640830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-edab51af-2ee2-48b2-ac42-8142bb6613fe tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:02.641690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-edab51af-2ee2-48b2-ac42-8142bb6613fe tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:02.642124 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-edab51af-2ee2-48b2-ac42-8142bb6613fe tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:02.773618 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-edab51af-2ee2-48b2-ac42-8142bb6613fe tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:02.781061 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-edab51af-2ee2-48b2-ac42-8142bb6613fe tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1573 microversion: 2.1 time: 0.151731 Jun 16 00:34:02.782129 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 409/840] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:02 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:03.518202 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7fb347fe-e7b1-494d-b829-f35555f2ce54 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:03.518807 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7fb347fe-e7b1-494d-b829-f35555f2ce54 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:03.525591 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7fb347fe-e7b1-494d-b829-f35555f2ce54 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:03.526059 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7fb347fe-e7b1-494d-b829-f35555f2ce54 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:03.526816 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7fb347fe-e7b1-494d-b829-f35555f2ce54 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:03.527250 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7fb347fe-e7b1-494d-b829-f35555f2ce54 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:03.531178 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:03.653858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7fb347fe-e7b1-494d-b829-f35555f2ce54 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:03.661571 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7fb347fe-e7b1-494d-b829-f35555f2ce54 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1362 microversion: 2.1 time: 0.147258 Jun 16 00:34:03.662118 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 432/841] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:03 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:03.798362 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ebca42b0-eef8-4bdf-8ae9-cb7de0d68d5f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:03.798966 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ebca42b0-eef8-4bdf-8ae9-cb7de0d68d5f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:03.805619 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ebca42b0-eef8-4bdf-8ae9-cb7de0d68d5f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:03.806067 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ebca42b0-eef8-4bdf-8ae9-cb7de0d68d5f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:03.806836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ebca42b0-eef8-4bdf-8ae9-cb7de0d68d5f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:03.807260 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ebca42b0-eef8-4bdf-8ae9-cb7de0d68d5f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:03.936682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ebca42b0-eef8-4bdf-8ae9-cb7de0d68d5f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:03.944276 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ebca42b0-eef8-4bdf-8ae9-cb7de0d68d5f tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1573 microversion: 2.1 time: 0.149804 Jun 16 00:34:03.944838 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 410/842] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:03 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:04.395684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-b97c9d12-3607-4aeb-92af-50021aca302e req-3114ea0c-53e7-4589-8fb0-c4c146468cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f39b67-fe8c-4a0a-8ac8-ca589391af83", "name": "network-vif-plugged", "status": "completed", "tag": "2a8ee73b-38ca-40d3-b4f0-c1b095af5c9e"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:04.400227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:04.400924 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=12 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:04.406476 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-b97c9d12-3607-4aeb-92af-50021aca302e req-3114ea0c-53e7-4589-8fb0-c4c146468cb5 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:04.407061 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-b97c9d12-3607-4aeb-92af-50021aca302e req-3114ea0c-53e7-4589-8fb0-c4c146468cb5 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:04.418866 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-b97c9d12-3607-4aeb-92af-50021aca302e req-3114ea0c-53e7-4589-8fb0-c4c146468cb5 service nova] Creating event network-vif-plugged:2a8ee73b-38ca-40d3-b4f0-c1b095af5c9e for instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 on hv-cinder-84327 Jun 16 00:34:04.423959 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-b97c9d12-3607-4aeb-92af-50021aca302e req-3114ea0c-53e7-4589-8fb0-c4c146468cb5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032903 Jun 16 00:34:04.424852 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 433/843] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:04.678792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f7a0ae45-d37c-4e0d-af19-f6c98a535730 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:04.679404 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f7a0ae45-d37c-4e0d-af19-f6c98a535730 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:04.685570 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f7a0ae45-d37c-4e0d-af19-f6c98a535730 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:04.686019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f7a0ae45-d37c-4e0d-af19-f6c98a535730 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:04.686783 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f7a0ae45-d37c-4e0d-af19-f6c98a535730 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:04.687224 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f7a0ae45-d37c-4e0d-af19-f6c98a535730 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:04.824764 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f7a0ae45-d37c-4e0d-af19-f6c98a535730 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:04.832227 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f7a0ae45-d37c-4e0d-af19-f6c98a535730 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1362 microversion: 2.1 time: 0.157287 Jun 16 00:34:04.832790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 411/844] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:04 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:04.962743 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2f4542d7-0ecd-4b12-8482-c5452c5b646d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:04.963432 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2f4542d7-0ecd-4b12-8482-c5452c5b646d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:04.970085 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2f4542d7-0ecd-4b12-8482-c5452c5b646d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:04.970531 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2f4542d7-0ecd-4b12-8482-c5452c5b646d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:04.971284 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2f4542d7-0ecd-4b12-8482-c5452c5b646d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:04.971744 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2f4542d7-0ecd-4b12-8482-c5452c5b646d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:05.100722 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2f4542d7-0ecd-4b12-8482-c5452c5b646d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:05.108034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2f4542d7-0ecd-4b12-8482-c5452c5b646d tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1573 microversion: 2.1 time: 0.149894 Jun 16 00:34:05.108591 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 434/845] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:04 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:34:05.848520 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d5f69389-9be7-4578-9e33-6b6d48a4664f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:05.849134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d5f69389-9be7-4578-9e33-6b6d48a4664f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:05.855586 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d5f69389-9be7-4578-9e33-6b6d48a4664f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:05.856065 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d5f69389-9be7-4578-9e33-6b6d48a4664f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:05.856826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d5f69389-9be7-4578-9e33-6b6d48a4664f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:05.857261 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d5f69389-9be7-4578-9e33-6b6d48a4664f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:05.981495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-d5f69389-9be7-4578-9e33-6b6d48a4664f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:05.989391 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d5f69389-9be7-4578-9e33-6b6d48a4664f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1362 microversion: 2.1 time: 0.144729 Jun 16 00:34:05.989946 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 412/846] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:05 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:06.125425 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-71977a8d-51b7-4515-a3d5-5f7a41fd38a4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:06.125941 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-71977a8d-51b7-4515-a3d5-5f7a41fd38a4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:06.133096 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-71977a8d-51b7-4515-a3d5-5f7a41fd38a4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:06.133547 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-71977a8d-51b7-4515-a3d5-5f7a41fd38a4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:06.134305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-71977a8d-51b7-4515-a3d5-5f7a41fd38a4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:06.134742 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-71977a8d-51b7-4515-a3d5-5f7a41fd38a4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:06.262472 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-71977a8d-51b7-4515-a3d5-5f7a41fd38a4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:06.270199 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-71977a8d-51b7-4515-a3d5-5f7a41fd38a4 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1573 microversion: 2.1 time: 0.148640 Jun 16 00:34:06.270788 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 435/847] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:06 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:07.005975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-33615820-f017-4ae7-8b57-c955043f98cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:07.006618 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-33615820-f017-4ae7-8b57-c955043f98cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:07.012938 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-33615820-f017-4ae7-8b57-c955043f98cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:07.013387 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-33615820-f017-4ae7-8b57-c955043f98cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:07.014182 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-33615820-f017-4ae7-8b57-c955043f98cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:07.014673 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-33615820-f017-4ae7-8b57-c955043f98cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:07.156440 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-33615820-f017-4ae7-8b57-c955043f98cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:07.164153 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-33615820-f017-4ae7-8b57-c955043f98cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1548 microversion: 2.1 time: 0.162020 Jun 16 00:34:07.164719 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 413/848] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:07 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:07.180426 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-736287fb-f7a4-43bc-8c2a-741bf7dea352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:07.180914 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-736287fb-f7a4-43bc-8c2a-741bf7dea352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:07.187290 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-736287fb-f7a4-43bc-8c2a-741bf7dea352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:07.187772 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-736287fb-f7a4-43bc-8c2a-741bf7dea352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:07.188536 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-736287fb-f7a4-43bc-8c2a-741bf7dea352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:07.188968 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-736287fb-f7a4-43bc-8c2a-741bf7dea352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:07.263828 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-736287fb-f7a4-43bc-8c2a-741bf7dea352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087257 Jun 16 00:34:07.264424 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 436/849] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 16 00:34:07 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:07.286147 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d679664f-c23b-4d40-bb94-26933b5f3757 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:07.286760 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d679664f-c23b-4d40-bb94-26933b5f3757 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:07.292686 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d679664f-c23b-4d40-bb94-26933b5f3757 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:07.293136 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d679664f-c23b-4d40-bb94-26933b5f3757 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:07.293902 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d679664f-c23b-4d40-bb94-26933b5f3757 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:07.294341 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d679664f-c23b-4d40-bb94-26933b5f3757 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:07.311959 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:07.567909 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-d679664f-c23b-4d40-bb94-26933b5f3757 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:07.575412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d679664f-c23b-4d40-bb94-26933b5f3757 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1573 microversion: 2.1 time: 0.293200 Jun 16 00:34:07.575997 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 414/850] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:07 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1573 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:08.450299 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-2e92d78c-0050-4679-b2d7-515ffc6a851c req-9954ee42-d2f4-4bc4-82c3-c84d95cb0378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f39b67-fe8c-4a0a-8ac8-ca589391af83", "tag": "2a8ee73b-38ca-40d3-b4f0-c1b095af5c9e"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:08.454707 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-62e8a7a1-0ce7-4a25-a4d4-83bd2c2fd10d req-5955597e-131e-4eef-9023-79f83cd832a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb151dc-a559-4ad5-9a4f-c55e2609758f", "name": "network-vif-plugged", "status": "completed", "tag": "bf8752fe-370d-4c67-8d58-5ab0ba31fdc9"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:08.459574 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-2e92d78c-0050-4679-b2d7-515ffc6a851c req-9954ee42-d2f4-4bc4-82c3-c84d95cb0378 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:08.461369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-2e92d78c-0050-4679-b2d7-515ffc6a851c req-9954ee42-d2f4-4bc4-82c3-c84d95cb0378 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:08.464638 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-62e8a7a1-0ce7-4a25-a4d4-83bd2c2fd10d req-5955597e-131e-4eef-9023-79f83cd832a8 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:08.465184 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-62e8a7a1-0ce7-4a25-a4d4-83bd2c2fd10d req-5955597e-131e-4eef-9023-79f83cd832a8 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:08.475436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-2e92d78c-0050-4679-b2d7-515ffc6a851c req-9954ee42-d2f4-4bc4-82c3-c84d95cb0378 service nova] Creating event network-changed:2a8ee73b-38ca-40d3-b4f0-c1b095af5c9e for instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 on hv-cinder-84327 Jun 16 00:34:08.477198 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-62e8a7a1-0ce7-4a25-a4d4-83bd2c2fd10d req-5955597e-131e-4eef-9023-79f83cd832a8 service nova] Creating event network-vif-plugged:bf8752fe-370d-4c67-8d58-5ab0ba31fdc9 for instance ebb151dc-a559-4ad5-9a4f-c55e2609758f on hv-cinder-84327 Jun 16 00:34:08.480317 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-2e92d78c-0050-4679-b2d7-515ffc6a851c req-9954ee42-d2f4-4bc4-82c3-c84d95cb0378 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034101 Jun 16 00:34:08.480915 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 437/851] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:08.482502 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-62e8a7a1-0ce7-4a25-a4d4-83bd2c2fd10d req-5955597e-131e-4eef-9023-79f83cd832a8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031728 Jun 16 00:34:08.484035 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 415/852] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:34:08.593583 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f4331824-588b-45bf-a2bd-e4a12451b3de tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:08.594574 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f4331824-588b-45bf-a2bd-e4a12451b3de tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:08.601788 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4331824-588b-45bf-a2bd-e4a12451b3de tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:08.602459 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4331824-588b-45bf-a2bd-e4a12451b3de tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:08.603236 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4331824-588b-45bf-a2bd-e4a12451b3de tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:08.603697 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f4331824-588b-45bf-a2bd-e4a12451b3de tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:08.747840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f4331824-588b-45bf-a2bd-e4a12451b3de tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:08.756309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f4331824-588b-45bf-a2bd-e4a12451b3de tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1573 microversion: 2.1 time: 0.167513 Jun 16 00:34:08.761718 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 438/853] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:08 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:09.774548 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-503eee1b-5bd4-4907-8ebd-db9c6ab2802a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:09.775233 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-503eee1b-5bd4-4907-8ebd-db9c6ab2802a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:09.781405 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-503eee1b-5bd4-4907-8ebd-db9c6ab2802a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:09.781853 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-503eee1b-5bd4-4907-8ebd-db9c6ab2802a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:09.782641 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-503eee1b-5bd4-4907-8ebd-db9c6ab2802a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:09.783076 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-503eee1b-5bd4-4907-8ebd-db9c6ab2802a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:09.912195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-503eee1b-5bd4-4907-8ebd-db9c6ab2802a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:09.919624 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-503eee1b-5bd4-4907-8ebd-db9c6ab2802a tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1573 microversion: 2.1 time: 0.150098 Jun 16 00:34:09.920206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 416/854] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:09 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:10.938166 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-84ece5ef-aa7b-4c9c-89d3-bf3a08579779 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:10.938781 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-84ece5ef-aa7b-4c9c-89d3-bf3a08579779 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:10.945776 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-84ece5ef-aa7b-4c9c-89d3-bf3a08579779 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:10.946223 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-84ece5ef-aa7b-4c9c-89d3-bf3a08579779 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:10.946982 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-84ece5ef-aa7b-4c9c-89d3-bf3a08579779 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:10.947416 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-84ece5ef-aa7b-4c9c-89d3-bf3a08579779 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:11.077246 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-84ece5ef-aa7b-4c9c-89d3-bf3a08579779 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:11.085363 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-84ece5ef-aa7b-4c9c-89d3-bf3a08579779 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1560 microversion: 2.1 time: 0.150996 Jun 16 00:34:11.085919 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 439/855] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:10 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:53.571211 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9b3b4732-96bf-4808-ba41-d864d3c4ae0d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:53.571800 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9b3b4732-96bf-4808-ba41-d864d3c4ae0d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:53.574177 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=41 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:53.574843 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=10 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:53.580507 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9b3b4732-96bf-4808-ba41-d864d3c4ae0d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:53.581544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9b3b4732-96bf-4808-ba41-d864d3c4ae0d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:53.582317 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9b3b4732-96bf-4808-ba41-d864d3c4ae0d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:53.582756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9b3b4732-96bf-4808-ba41-d864d3c4ae0d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:53.605237 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9b3b4732-96bf-4808-ba41-d864d3c4ae0d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/ips" status: 200 len: 150 microversion: 2.1 time: 0.037854 Jun 16 00:34:53.605787 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 417/856] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 16 00:34:53 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:54.914105 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a9744ac5-81f8-4f95-93ee-55df8fc289e1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b0fddfc-be62-44c0-bf7b-04d00dda6be2"}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:54.915164 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a9744ac5-81f8-4f95-93ee-55df8fc289e1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:54.917585 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:54.918364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=36 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:54.924840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a9744ac5-81f8-4f95-93ee-55df8fc289e1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:54.925301 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a9744ac5-81f8-4f95-93ee-55df8fc289e1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:54.926067 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a9744ac5-81f8-4f95-93ee-55df8fc289e1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:54.926502 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a9744ac5-81f8-4f95-93ee-55df8fc289e1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:55.181275 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a9744ac5-81f8-4f95-93ee-55df8fc289e1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270891 Jun 16 00:34:55.181902 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 440/857] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:34:54 2022] POST /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:01.867671 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-767f7675-e9c6-4cd4-9803-90a9a5313694 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:01.868148 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-767f7675-e9c6-4cd4-9803-90a9a5313694 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:01.874705 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-767f7675-e9c6-4cd4-9803-90a9a5313694 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:01.875154 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-767f7675-e9c6-4cd4-9803-90a9a5313694 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:01.875944 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-767f7675-e9c6-4cd4-9803-90a9a5313694 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:01.876379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-767f7675-e9c6-4cd4-9803-90a9a5313694 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:01.900080 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-767f7675-e9c6-4cd4-9803-90a9a5313694 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/ips" status: 200 len: 151 microversion: 2.20 time: 0.036315 Jun 16 00:35:01.900643 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 418/858] 10.222.0.44 () {60 vars in 1288 bytes} [Thu Jun 16 00:35:01 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:35:02.657753 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-20246ea2-edc6-40d9-a28e-4764c440812b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b0fddfc-be62-44c0-bf7b-04d00dda6be2"}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:02.659457 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-20246ea2-edc6-40d9-a28e-4764c440812b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:02.666175 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-20246ea2-edc6-40d9-a28e-4764c440812b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:02.666632 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-20246ea2-edc6-40d9-a28e-4764c440812b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:02.667402 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-20246ea2-edc6-40d9-a28e-4764c440812b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:02.667864 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-20246ea2-edc6-40d9-a28e-4764c440812b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:02.745145 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-20246ea2-edc6-40d9-a28e-4764c440812b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Invalid volume: volume 4b0fddfc-be62-44c0-bf7b-04d00dda6be2 is already attached to instances: a897b2e2-7e05-4ed8-8252-ddaad24dff1c Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-20246ea2-edc6-40d9-a28e-4764c440812b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: POST /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-volume_attachments HTTP/1.1 Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 74 Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:35:02.746855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:35:02.748508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:35:02.748508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:35:02.748508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:35:02.748508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:35:02.748508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:35:02.748508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:35:02.748508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:35:02.748508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:35:02.748508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:35:02.748508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Jun 16 00:35:02.748508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {"volumeAttachment": {"volumeId": "4b0fddfc-be62-44c0-bf7b-04d00dda6be2"}} Jun 16 00:35:02.748508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Invalid volume: volume 4b0fddfc-be62-44c0-bf7b-04d00dda6be2 is already attached to instances: a897b2e2-7e05-4ed8-8252-ddaad24dff1c Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'server_id': 'a897b2e2-7e05-4ed8-8252-ddaad24dff1c', 'body': {'volumeAttachment': {'volumeId': '4b0fddfc-be62-44c0-bf7b-04d00dda6be2'}}} Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4b0fddfc-be62-44c0-bf7b-04d00dda6be2 is already attached to instances: a897b2e2-7e05-4ed8-8252-ddaad24dff1c Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:35:02.749450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4b0fddfc-be62-44c0-bf7b-04d00dda6be2 is already attached to instances: a897b2e2-7e05-4ed8-8252-ddaad24dff1c Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:35:02.750928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:35:02.752560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:35:02.752560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:35:02.752560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:35:02.752560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4b0fddfc-be62-44c0-bf7b-04d00dda6be2 is already attached to instances: a897b2e2-7e05-4ed8-8252-ddaad24dff1c Jun 16 00:35:02.752560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:35:02.752560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-20246ea2-edc6-40d9-a28e-4764c440812b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 400 to user: Invalid volume: volume 4b0fddfc-be62-44c0-bf7b-04d00dda6be2 is already attached to instances: a897b2e2-7e05-4ed8-8252-ddaad24dff1c {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:35:02.752560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-20246ea2-edc6-40d9-a28e-4764c440812b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095353 Jun 16 00:35:02.752560 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 441/859] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:35:02 2022] POST /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:35:02.810583 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-cf099b99-3bd5-4363-b269-982a2af71c80 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:02.811025 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-cf099b99-3bd5-4363-b269-982a2af71c80 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:02.817183 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cf099b99-3bd5-4363-b269-982a2af71c80 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:02.817635 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cf099b99-3bd5-4363-b269-982a2af71c80 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:02.818402 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cf099b99-3bd5-4363-b269-982a2af71c80 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:02.818839 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-cf099b99-3bd5-4363-b269-982a2af71c80 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:02.896994 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-cf099b99-3bd5-4363-b269-982a2af71c80 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lazy-loading 'services' on Instance uuid a897b2e2-7e05-4ed8-8252-ddaad24dff1c {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:35:02.968844 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-cf099b99-3bd5-4363-b269-982a2af71c80 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-volume_attachments/4b0fddfc-be62-44c0-bf7b-04d00dda6be2" status: 202 len: 0 microversion: 2.1 time: 0.162057 Jun 16 00:35:02.969440 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 419/860] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 16 00:35:02 2022] DELETE /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-volume_attachments/4b0fddfc-be62-44c0-bf7b-04d00dda6be2 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:35:02.978373 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fda31ed2-1a50-47af-b2ba-2509d2d03419 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:02.979286 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fda31ed2-1a50-47af-b2ba-2509d2d03419 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:02.986343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fda31ed2-1a50-47af-b2ba-2509d2d03419 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:02.986771 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fda31ed2-1a50-47af-b2ba-2509d2d03419 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:02.987911 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fda31ed2-1a50-47af-b2ba-2509d2d03419 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:02.988492 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fda31ed2-1a50-47af-b2ba-2509d2d03419 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:03.017360 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fda31ed2-1a50-47af-b2ba-2509d2d03419 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042968 Jun 16 00:35:03.018446 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 442/861] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:35:02 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:03.741234 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d488a763-d735-476d-bc81-1c7528263dba tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:03.741876 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d488a763-d735-476d-bc81-1c7528263dba tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:03.748107 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d488a763-d735-476d-bc81-1c7528263dba tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:03.748553 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d488a763-d735-476d-bc81-1c7528263dba tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:03.749317 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d488a763-d735-476d-bc81-1c7528263dba tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:03.749752 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d488a763-d735-476d-bc81-1c7528263dba tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:03.925409 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-d488a763-d735-476d-bc81-1c7528263dba tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lazy-loading 'flavor' on Instance uuid 3a5a227f-6658-4f75-9193-65c781e2748f {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:35:04.029795 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fedb0c0b-dd43-4873-8728-a885d1db9cb8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:04.030710 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fedb0c0b-dd43-4873-8728-a885d1db9cb8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:04.037719 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fedb0c0b-dd43-4873-8728-a885d1db9cb8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.038168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fedb0c0b-dd43-4873-8728-a885d1db9cb8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.038927 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fedb0c0b-dd43-4873-8728-a885d1db9cb8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.039360 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fedb0c0b-dd43-4873-8728-a885d1db9cb8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.067099 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fedb0c0b-dd43-4873-8728-a885d1db9cb8 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041261 Jun 16 00:35:04.067656 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 443/862] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:35:04 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 00:35:04.123934 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8f8b4e7e-b93f-482a-aa78-cb9c8928ecda tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:04.124435 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8f8b4e7e-b93f-482a-aa78-cb9c8928ecda tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:04.130987 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8f8b4e7e-b93f-482a-aa78-cb9c8928ecda tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.131442 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8f8b4e7e-b93f-482a-aa78-cb9c8928ecda tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.132382 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8f8b4e7e-b93f-482a-aa78-cb9c8928ecda tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.132820 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8f8b4e7e-b93f-482a-aa78-cb9c8928ecda tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.158737 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8f8b4e7e-b93f-482a-aa78-cb9c8928ecda tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Going to try to terminate instance {{(pid=129466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:35:04.180094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d488a763-d735-476d-bc81-1c7528263dba tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "POST /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/action" status: 202 len: 0 microversion: 2.20 time: 0.442979 Jun 16 00:35:04.181035 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 420/863] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jun 16 00:35:03 2022] POST /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:35:04.190055 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-71aa3532-625c-4102-8b4e-8f72ca700f3e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:04.190986 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-71aa3532-625c-4102-8b4e-8f72ca700f3e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:04.197752 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-71aa3532-625c-4102-8b4e-8f72ca700f3e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.198465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-71aa3532-625c-4102-8b4e-8f72ca700f3e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.199551 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-71aa3532-625c-4102-8b4e-8f72ca700f3e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.200487 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-71aa3532-625c-4102-8b4e-8f72ca700f3e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.242786 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8f8b4e7e-b93f-482a-aa78-cb9c8928ecda tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 204 len: 0 microversion: 2.1 time: 0.122307 Jun 16 00:35:04.243367 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 444/864] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:35:04 2022] DELETE /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 00:35:04.252063 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1ad0ae0b-9856-42ed-9167-a153bc0e081f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:04.252765 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1ad0ae0b-9856-42ed-9167-a153bc0e081f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:04.258829 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1ad0ae0b-9856-42ed-9167-a153bc0e081f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.259281 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1ad0ae0b-9856-42ed-9167-a153bc0e081f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.260147 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1ad0ae0b-9856-42ed-9167-a153bc0e081f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.260609 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1ad0ae0b-9856-42ed-9167-a153bc0e081f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.391965 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-71aa3532-625c-4102-8b4e-8f72ca700f3e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:04.400826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-71aa3532-625c-4102-8b4e-8f72ca700f3e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:04.402424 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-71aa3532-625c-4102-8b4e-8f72ca700f3e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:04.403687 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-71aa3532-625c-4102-8b4e-8f72ca700f3e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.218319 Jun 16 00:35:04.404316 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 421/865] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:04 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:04.420630 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1ad0ae0b-9856-42ed-9167-a153bc0e081f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:04.428815 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1ad0ae0b-9856-42ed-9167-a153bc0e081f tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1682 microversion: 2.1 time: 0.181001 Jun 16 00:35:04.429365 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 445/866] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:04 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:05.421294 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a1b645ba-90b0-4a84-99ad-892354772269 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:05.421881 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a1b645ba-90b0-4a84-99ad-892354772269 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:05.428359 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a1b645ba-90b0-4a84-99ad-892354772269 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:05.428815 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a1b645ba-90b0-4a84-99ad-892354772269 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:05.429580 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a1b645ba-90b0-4a84-99ad-892354772269 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:05.430018 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a1b645ba-90b0-4a84-99ad-892354772269 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:05.446070 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-65510b00-7981-44be-8505-9f3eb48e7c29 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:05.446686 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-65510b00-7981-44be-8505-9f3eb48e7c29 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:05.453360 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-65510b00-7981-44be-8505-9f3eb48e7c29 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:05.453807 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-65510b00-7981-44be-8505-9f3eb48e7c29 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:05.454583 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-65510b00-7981-44be-8505-9f3eb48e7c29 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:05.455025 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-65510b00-7981-44be-8505-9f3eb48e7c29 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:05.622163 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a1b645ba-90b0-4a84-99ad-892354772269 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:05.629408 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-65510b00-7981-44be-8505-9f3eb48e7c29 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:05.630573 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a1b645ba-90b0-4a84-99ad-892354772269 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:05.632093 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a1b645ba-90b0-4a84-99ad-892354772269 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:05.633257 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a1b645ba-90b0-4a84-99ad-892354772269 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.215853 Jun 16 00:35:05.633813 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 422/867] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:05 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:05.637036 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-65510b00-7981-44be-8505-9f3eb48e7c29 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1682 microversion: 2.1 time: 0.194760 Jun 16 00:35:05.637582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 446/868] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:05 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:06.652382 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-28f99d62-46e2-434f-af8d-eea9dae76f12 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:06.652999 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-28f99d62-46e2-434f-af8d-eea9dae76f12 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:06.654240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-964ff70e-6f8a-4212-9b5e-c430524bee45 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:06.654848 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-964ff70e-6f8a-4212-9b5e-c430524bee45 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:06.660261 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-28f99d62-46e2-434f-af8d-eea9dae76f12 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:06.660718 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-28f99d62-46e2-434f-af8d-eea9dae76f12 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:06.661481 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-28f99d62-46e2-434f-af8d-eea9dae76f12 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:06.661920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-28f99d62-46e2-434f-af8d-eea9dae76f12 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:06.662026 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-964ff70e-6f8a-4212-9b5e-c430524bee45 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:06.662369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-964ff70e-6f8a-4212-9b5e-c430524bee45 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:06.663123 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-964ff70e-6f8a-4212-9b5e-c430524bee45 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:06.663553 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-964ff70e-6f8a-4212-9b5e-c430524bee45 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:06.857591 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-28f99d62-46e2-434f-af8d-eea9dae76f12 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:06.862309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-964ff70e-6f8a-4212-9b5e-c430524bee45 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:06.866406 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-28f99d62-46e2-434f-af8d-eea9dae76f12 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:06.867924 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-28f99d62-46e2-434f-af8d-eea9dae76f12 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:06.869102 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-28f99d62-46e2-434f-af8d-eea9dae76f12 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.220699 Jun 16 00:35:06.869848 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 423/869] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:06 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:06.870871 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-964ff70e-6f8a-4212-9b5e-c430524bee45 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1682 microversion: 2.1 time: 0.220255 Jun 16 00:35:06.878662 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 447/870] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:06 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:07.764302 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-f34988c9-4566-466b-a473-305502ba74da req-b1244b90-e156-444f-8768-d1f046cef29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a897b2e2-7e05-4ed8-8252-ddaad24dff1c", "name": "network-vif-deleted", "tag": "5974f694-19d6-4042-9866-6cb0677cf33f"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:07.773398 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-f34988c9-4566-466b-a473-305502ba74da req-b1244b90-e156-444f-8768-d1f046cef29d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.773846 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-f34988c9-4566-466b-a473-305502ba74da req-b1244b90-e156-444f-8768-d1f046cef29d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.786347 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-f34988c9-4566-466b-a473-305502ba74da req-b1244b90-e156-444f-8768-d1f046cef29d service nova] Creating event network-vif-deleted:5974f694-19d6-4042-9866-6cb0677cf33f for instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c on hv-cinder-84327 Jun 16 00:35:07.792367 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-f34988c9-4566-466b-a473-305502ba74da req-b1244b90-e156-444f-8768-d1f046cef29d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031523 Jun 16 00:35:07.793212 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 424/871] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:07.888436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-570792a8-28ee-49e3-82ac-e1b79e48bdfc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:07.889701 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-570792a8-28ee-49e3-82ac-e1b79e48bdfc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:07.896058 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-91c0bce4-eddc-47b8-be53-3a2a2d855fb9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:07.896765 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-91c0bce4-eddc-47b8-be53-3a2a2d855fb9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:07.896911 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-570792a8-28ee-49e3-82ac-e1b79e48bdfc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.897608 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-570792a8-28ee-49e3-82ac-e1b79e48bdfc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.898395 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-570792a8-28ee-49e3-82ac-e1b79e48bdfc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.901358 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-570792a8-28ee-49e3-82ac-e1b79e48bdfc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.911484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-91c0bce4-eddc-47b8-be53-3a2a2d855fb9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.912779 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-91c0bce4-eddc-47b8-be53-3a2a2d855fb9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.916548 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-91c0bce4-eddc-47b8-be53-3a2a2d855fb9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.917246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-91c0bce4-eddc-47b8-be53-3a2a2d855fb9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:08.059355 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-91c0bce4-eddc-47b8-be53-3a2a2d855fb9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:08.069443 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-91c0bce4-eddc-47b8-be53-3a2a2d855fb9 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 200 len: 1326 microversion: 2.1 time: 0.184950 Jun 16 00:35:08.077506 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 425/872] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:07 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 1326 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:08.103013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-570792a8-28ee-49e3-82ac-e1b79e48bdfc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:08.110933 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-570792a8-28ee-49e3-82ac-e1b79e48bdfc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:08.112957 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-570792a8-28ee-49e3-82ac-e1b79e48bdfc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:08.114186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-570792a8-28ee-49e3-82ac-e1b79e48bdfc tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.230097 Jun 16 00:35:08.114732 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 448/873] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:07 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:09.086203 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c7df8dc0-97f8-429d-80e0-153f2f97e24d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:09.086837 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c7df8dc0-97f8-429d-80e0-153f2f97e24d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:09.093203 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c7df8dc0-97f8-429d-80e0-153f2f97e24d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:09.093646 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c7df8dc0-97f8-429d-80e0-153f2f97e24d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:09.094434 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c7df8dc0-97f8-429d-80e0-153f2f97e24d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:09.094864 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c7df8dc0-97f8-429d-80e0-153f2f97e24d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:09.107894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-c7df8dc0-97f8-429d-80e0-153f2f97e24d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c7df8dc0-97f8-429d-80e0-153f2f97e24d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c HTTP/1.1 Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:35:09.109484 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:35:09.111095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:35:09.111095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:35:09.111095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:35:09.111095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:35:09.111095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:35:09.111095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:35:09.111095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:35:09.111095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:35:09.111095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:35:09.111095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:35:09.111095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:35:09.111095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': 'a897b2e2-7e05-4ed8-8252-ddaad24dff1c'} Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:35:09.112623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:35:09.114208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:35:09.115757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c7df8dc0-97f8-429d-80e0-153f2f97e24d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 404 to user: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:35:09.115757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c7df8dc0-97f8-429d-80e0-153f2f97e24d tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 404 len: 111 microversion: 2.1 time: 0.028547 Jun 16 00:35:09.115757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 426/874] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:09 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:35:09.120158 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-bec1beef-6ee4-4919-bf38-9c38f36e81ec tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '.version_select at 0x7f9573c24310>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:09.132624 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8a01808c-c3c0-476b-b389-ac08e4e66f21 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:09.133254 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8a01808c-c3c0-476b-b389-ac08e4e66f21 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:09.137873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-bec1beef-6ee4-4919-bf38-9c38f36e81ec tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757627005" status: 202 len: 0 microversion: 2.1 time: 0.021425 Jun 16 00:35:09.138418 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 449/875] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jun 16 00:35:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757627005 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:35:09.139206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8a01808c-c3c0-476b-b389-ac08e4e66f21 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:09.139700 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8a01808c-c3c0-476b-b389-ac08e4e66f21 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:09.140476 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8a01808c-c3c0-476b-b389-ac08e4e66f21 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:09.140918 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8a01808c-c3c0-476b-b389-ac08e4e66f21 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:09.329931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8a01808c-c3c0-476b-b389-ac08e4e66f21 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:09.338108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8a01808c-c3c0-476b-b389-ac08e4e66f21 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:09.339550 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8a01808c-c3c0-476b-b389-ac08e4e66f21 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:09.340739 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8a01808c-c3c0-476b-b389-ac08e4e66f21 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.211915 Jun 16 00:35:09.341299 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 427/876] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:09 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:09.817482 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f128c959-855b-4384-af1e-9346ef5566dc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: .version_select at 0x7f9573b74ca0>, body: {"keypair": {"name": "tempest-keypair-407689939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgRgd2o5UWE1WW8tBRsu9G8qBv6txnC+M55DCKjfbaHoAm3ASl3KH9C8rrkaPt0FZZeXsUuo4XmS7OPgtbkbFPhXSustWTutzIE0B9eFAv6yF5+A0bjbrHtnMhnQ1Ju1A=="}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:09.832147 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-f128c959-855b-4384-af1e-9346ef5566dc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for project def39ced63b64e3aa65c9542ae512e7e. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:35:09.835979 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-f128c959-855b-4384-af1e-9346ef5566dc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for user f0c5a5705f34440abce48190674a76d5 and project def39ced63b64e3aa65c9542ae512e7e. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:35:09.857165 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f128c959-855b-4384-af1e-9346ef5566dc tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043532 Jun 16 00:35:09.857742 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 450/877] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 16 00:35:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:10.359091 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-99da2b31-5526-4194-99da-2129354836c4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:10.359729 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-99da2b31-5526-4194-99da-2129354836c4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:10.365871 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99da2b31-5526-4194-99da-2129354836c4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:10.366323 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99da2b31-5526-4194-99da-2129354836c4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:10.367086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99da2b31-5526-4194-99da-2129354836c4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:10.367524 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99da2b31-5526-4194-99da-2129354836c4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:10.504418 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-99da2b31-5526-4194-99da-2129354836c4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:10.512993 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-99da2b31-5526-4194-99da-2129354836c4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:10.514491 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-99da2b31-5526-4194-99da-2129354836c4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:10.515684 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-99da2b31-5526-4194-99da-2129354836c4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.160430 Jun 16 00:35:10.516232 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 428/878] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:10 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:11.109492 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-256334553", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a813215-bb6e-4258-9089-1e234ad6c22c"}], "security_groups": [{"name": "tempest-securitygroup--526044101"}], "key_name": "tempest-keypair-407689939", "user_data": "}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:11.217173 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.network.neutron [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] validate_networks() for [('0a813215-bb6e-4258-9089-1e234ad6c22c', None, None, None, None, None)] {{(pid=129466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:35:11.534749 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b55e1fbe-4d9e-4ffd-a5c6-cda3fb4a5a79 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:11.535378 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b55e1fbe-4d9e-4ffd-a5c6-cda3fb4a5a79 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:11.541785 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b55e1fbe-4d9e-4ffd-a5c6-cda3fb4a5a79 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:11.542229 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b55e1fbe-4d9e-4ffd-a5c6-cda3fb4a5a79 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:11.542988 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b55e1fbe-4d9e-4ffd-a5c6-cda3fb4a5a79 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:11.543420 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b55e1fbe-4d9e-4ffd-a5c6-cda3fb4a5a79 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:11.578693 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Flavor limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:35:11.579210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Image limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:35:11.579791 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Flavor pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:35:11.580817 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Image pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:35:11.581291 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:35:11.591052 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:11.591501 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:11.592382 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:11.592847 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:11.609164 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for project def39ced63b64e3aa65c9542ae512e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:35:11.613864 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Getting quotas for user f0c5a5705f34440abce48190674a76d5 and project def39ced63b64e3aa65c9542ae512e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:35:11.624807 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Going to run 1 instances... {{(pid=129466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:35:11.627566 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:35:11.675682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b55e1fbe-4d9e-4ffd-a5c6-cda3fb4a5a79 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:11.676392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8bf810a9-0e32-4220-886e-f25f8634c227 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.571649 Jun 16 00:35:11.677263 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 451/879] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:35:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:35:11.687305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ed71798b-a580-4b89-93b3-de71ee6085bd tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:11.687957 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ed71798b-a580-4b89-93b3-de71ee6085bd tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:11.690542 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b55e1fbe-4d9e-4ffd-a5c6-cda3fb4a5a79 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:11.692145 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b55e1fbe-4d9e-4ffd-a5c6-cda3fb4a5a79 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:11.693887 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b55e1fbe-4d9e-4ffd-a5c6-cda3fb4a5a79 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.163655 Jun 16 00:35:11.694666 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 429/880] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:11 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:11.744004 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ed71798b-a580-4b89-93b3-de71ee6085bd tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:11.750607 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ed71798b-a580-4b89-93b3-de71ee6085bd tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1240 microversion: 2.1 time: 0.067266 Jun 16 00:35:11.751158 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 452/881] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:11 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:12.712651 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-830c6f00-720d-4e07-b6fa-bf30599c2c1d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:12.713731 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-830c6f00-720d-4e07-b6fa-bf30599c2c1d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:12.721257 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-830c6f00-720d-4e07-b6fa-bf30599c2c1d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:12.722625 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-830c6f00-720d-4e07-b6fa-bf30599c2c1d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:12.723679 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-830c6f00-720d-4e07-b6fa-bf30599c2c1d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:12.724342 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-830c6f00-720d-4e07-b6fa-bf30599c2c1d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:12.768306 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f6db7ba0-1977-40a8-ac36-57917dd8b9e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:12.769202 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f6db7ba0-1977-40a8-ac36-57917dd8b9e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:12.777041 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f6db7ba0-1977-40a8-ac36-57917dd8b9e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:12.777517 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f6db7ba0-1977-40a8-ac36-57917dd8b9e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:12.778411 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f6db7ba0-1977-40a8-ac36-57917dd8b9e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:12.778910 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f6db7ba0-1977-40a8-ac36-57917dd8b9e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:12.868769 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f6db7ba0-1977-40a8-ac36-57917dd8b9e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:12.875969 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f6db7ba0-1977-40a8-ac36-57917dd8b9e3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1310 microversion: 2.1 time: 0.112612 Jun 16 00:35:12.876767 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 453/882] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:12 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1310 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:12.900789 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-830c6f00-720d-4e07-b6fa-bf30599c2c1d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:12.908784 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-830c6f00-720d-4e07-b6fa-bf30599c2c1d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:12.910280 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-830c6f00-720d-4e07-b6fa-bf30599c2c1d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:12.911519 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-830c6f00-720d-4e07-b6fa-bf30599c2c1d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.203245 Jun 16 00:35:12.915958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 430/883] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:12 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:13.893796 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d81e8090-e85f-42ce-ada7-5ab76dea51f3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:13.894706 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d81e8090-e85f-42ce-ada7-5ab76dea51f3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:13.901440 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d81e8090-e85f-42ce-ada7-5ab76dea51f3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:13.901890 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d81e8090-e85f-42ce-ada7-5ab76dea51f3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:13.902657 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d81e8090-e85f-42ce-ada7-5ab76dea51f3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:13.903119 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d81e8090-e85f-42ce-ada7-5ab76dea51f3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:13.929886 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ea8fa156-f5f5-45fe-a5ff-671e56ea08a8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:13.931879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ea8fa156-f5f5-45fe-a5ff-671e56ea08a8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:13.937394 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ea8fa156-f5f5-45fe-a5ff-671e56ea08a8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:13.937888 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ea8fa156-f5f5-45fe-a5ff-671e56ea08a8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:13.938658 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ea8fa156-f5f5-45fe-a5ff-671e56ea08a8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:13.939138 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ea8fa156-f5f5-45fe-a5ff-671e56ea08a8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:14.113888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d81e8090-e85f-42ce-ada7-5ab76dea51f3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:14.121633 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d81e8090-e85f-42ce-ada7-5ab76dea51f3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1365 microversion: 2.1 time: 0.231734 Jun 16 00:35:14.122994 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 454/884] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:13 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:14.151440 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ea8fa156-f5f5-45fe-a5ff-671e56ea08a8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:14.164413 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ea8fa156-f5f5-45fe-a5ff-671e56ea08a8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:14.166324 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ea8fa156-f5f5-45fe-a5ff-671e56ea08a8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:14.167737 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ea8fa156-f5f5-45fe-a5ff-671e56ea08a8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.242189 Jun 16 00:35:14.168319 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 431/885] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:13 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:14.198048 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-c4b043cd-de92-434f-86ab-6bc157fee80b req-5c17aa77-5feb-439d-af6f-5d7c107c66fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0ebcc60-4082-48e9-8efa-dd22c7e01774", "tag": "e22ec279-19d4-4801-949d-a1ac3d959175"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:14.208896 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-c4b043cd-de92-434f-86ab-6bc157fee80b req-5c17aa77-5feb-439d-af6f-5d7c107c66fd service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:14.209340 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-c4b043cd-de92-434f-86ab-6bc157fee80b req-5c17aa77-5feb-439d-af6f-5d7c107c66fd service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:14.226350 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-c4b043cd-de92-434f-86ab-6bc157fee80b req-5c17aa77-5feb-439d-af6f-5d7c107c66fd service nova] Creating event network-changed:e22ec279-19d4-4801-949d-a1ac3d959175 for instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 on hv-cinder-84327 Jun 16 00:35:14.232173 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-c4b043cd-de92-434f-86ab-6bc157fee80b req-5c17aa77-5feb-439d-af6f-5d7c107c66fd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039015 Jun 16 00:35:14.233042 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 455/886] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:15.139005 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d1cd8523-7dc2-4d36-b11c-abbdcd59107b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:15.139539 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d1cd8523-7dc2-4d36-b11c-abbdcd59107b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:15.146300 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d1cd8523-7dc2-4d36-b11c-abbdcd59107b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:15.146754 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d1cd8523-7dc2-4d36-b11c-abbdcd59107b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:15.147733 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d1cd8523-7dc2-4d36-b11c-abbdcd59107b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:15.148190 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d1cd8523-7dc2-4d36-b11c-abbdcd59107b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:15.186475 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-614b2f41-6fc8-461d-af55-15690bdb5ca6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:15.187168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-614b2f41-6fc8-461d-af55-15690bdb5ca6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:15.194927 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-614b2f41-6fc8-461d-af55-15690bdb5ca6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:15.195379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-614b2f41-6fc8-461d-af55-15690bdb5ca6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:15.196185 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-614b2f41-6fc8-461d-af55-15690bdb5ca6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:15.196625 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-614b2f41-6fc8-461d-af55-15690bdb5ca6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:15.329112 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-d1cd8523-7dc2-4d36-b11c-abbdcd59107b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:15.332617 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:15.337069 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d1cd8523-7dc2-4d36-b11c-abbdcd59107b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1365 microversion: 2.1 time: 0.202043 Jun 16 00:35:15.337631 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 432/887] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:15 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:15.356167 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-614b2f41-6fc8-461d-af55-15690bdb5ca6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:15.364683 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-614b2f41-6fc8-461d-af55-15690bdb5ca6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:15.366172 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-614b2f41-6fc8-461d-af55-15690bdb5ca6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:15.367351 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-614b2f41-6fc8-461d-af55-15690bdb5ca6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.185036 Jun 16 00:35:15.367926 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 456/888] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:15 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:16.354256 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-67bfba7b-279d-4cea-a3a0-0b75266a4ee6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:16.354856 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-67bfba7b-279d-4cea-a3a0-0b75266a4ee6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:16.362579 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-67bfba7b-279d-4cea-a3a0-0b75266a4ee6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.363024 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-67bfba7b-279d-4cea-a3a0-0b75266a4ee6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.363814 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-67bfba7b-279d-4cea-a3a0-0b75266a4ee6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.364247 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-67bfba7b-279d-4cea-a3a0-0b75266a4ee6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.385174 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2dd69da1-274d-4f51-b985-8105d891649d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:16.385786 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2dd69da1-274d-4f51-b985-8105d891649d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:16.392334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2dd69da1-274d-4f51-b985-8105d891649d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.392789 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2dd69da1-274d-4f51-b985-8105d891649d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.393634 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2dd69da1-274d-4f51-b985-8105d891649d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.394338 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2dd69da1-274d-4f51-b985-8105d891649d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.547144 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-67bfba7b-279d-4cea-a3a0-0b75266a4ee6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:16.555155 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-67bfba7b-279d-4cea-a3a0-0b75266a4ee6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1365 microversion: 2.1 time: 0.204727 Jun 16 00:35:16.555727 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 433/889] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:16 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:16.569450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2dd69da1-274d-4f51-b985-8105d891649d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:16.572958 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:16.578220 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2dd69da1-274d-4f51-b985-8105d891649d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:16.579744 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2dd69da1-274d-4f51-b985-8105d891649d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:16.580896 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2dd69da1-274d-4f51-b985-8105d891649d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.199598 Jun 16 00:35:16.581448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 457/890] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:16 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:17.572609 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-fea3041b-d911-4126-bf90-2bc475d32cd6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:17.573215 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-fea3041b-d911-4126-bf90-2bc475d32cd6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:17.579538 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fea3041b-d911-4126-bf90-2bc475d32cd6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:17.580014 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fea3041b-d911-4126-bf90-2bc475d32cd6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:17.581395 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fea3041b-d911-4126-bf90-2bc475d32cd6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:17.581844 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fea3041b-d911-4126-bf90-2bc475d32cd6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:17.600090 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-263ffa50-f69b-4ff5-ab16-260c20a7491f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:17.600793 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-263ffa50-f69b-4ff5-ab16-260c20a7491f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:17.608684 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-263ffa50-f69b-4ff5-ab16-260c20a7491f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:17.609248 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-263ffa50-f69b-4ff5-ab16-260c20a7491f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:17.610123 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-263ffa50-f69b-4ff5-ab16-260c20a7491f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:17.610632 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-263ffa50-f69b-4ff5-ab16-260c20a7491f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:17.780589 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fea3041b-d911-4126-bf90-2bc475d32cd6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:17.788809 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-fea3041b-d911-4126-bf90-2bc475d32cd6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1365 microversion: 2.1 time: 0.219944 Jun 16 00:35:17.789807 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 434/891] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:17 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:17.792000 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-263ffa50-f69b-4ff5-ab16-260c20a7491f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:17.801686 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-263ffa50-f69b-4ff5-ab16-260c20a7491f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:17.803174 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-263ffa50-f69b-4ff5-ab16-260c20a7491f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:17.804361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-263ffa50-f69b-4ff5-ab16-260c20a7491f tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1744 microversion: 2.20 time: 0.208159 Jun 16 00:35:17.804911 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 458/892] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:17 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1744 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:18.805685 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e46b369c-f9af-44b5-aff8-3cf080e1188c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:18.806304 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e46b369c-f9af-44b5-aff8-3cf080e1188c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:18.812803 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e46b369c-f9af-44b5-aff8-3cf080e1188c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:18.813256 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e46b369c-f9af-44b5-aff8-3cf080e1188c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:18.814024 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e46b369c-f9af-44b5-aff8-3cf080e1188c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:18.814463 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e46b369c-f9af-44b5-aff8-3cf080e1188c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:18.822798 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0caaf139-eda7-4feb-bd61-8c7979d177ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:18.823402 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0caaf139-eda7-4feb-bd61-8c7979d177ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:18.831432 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0caaf139-eda7-4feb-bd61-8c7979d177ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:18.832126 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0caaf139-eda7-4feb-bd61-8c7979d177ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:18.832912 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0caaf139-eda7-4feb-bd61-8c7979d177ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:18.833626 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0caaf139-eda7-4feb-bd61-8c7979d177ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:19.033575 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e46b369c-f9af-44b5-aff8-3cf080e1188c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:19.037658 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0caaf139-eda7-4feb-bd61-8c7979d177ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:19.041253 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e46b369c-f9af-44b5-aff8-3cf080e1188c tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1365 microversion: 2.1 time: 0.239434 Jun 16 00:35:19.041833 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 435/893] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:18 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:19.046150 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-09860591-50bc-4c18-a049-2dd977484d14 req-d5760ff9-6443-4c3e-85c9-40e9331940db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5a227f-6658-4f75-9193-65c781e2748f", "name": "network-vif-plugged", "status": "completed", "tag": "c16f9b3b-e924-4296-9815-07d0ab5a729b"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:19.050940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0caaf139-eda7-4feb-bd61-8c7979d177ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:19.053879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-09860591-50bc-4c18-a049-2dd977484d14 req-d5760ff9-6443-4c3e-85c9-40e9331940db service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:19.054313 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-09860591-50bc-4c18-a049-2dd977484d14 req-d5760ff9-6443-4c3e-85c9-40e9331940db service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:19.054704 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0caaf139-eda7-4feb-bd61-8c7979d177ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:19.057030 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0caaf139-eda7-4feb-bd61-8c7979d177ad tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1744 microversion: 2.20 time: 0.237669 Jun 16 00:35:19.058145 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 459/894] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:18 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1744 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:19.065635 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-09860591-50bc-4c18-a049-2dd977484d14 req-d5760ff9-6443-4c3e-85c9-40e9331940db service nova] Creating event network-vif-plugged:c16f9b3b-e924-4296-9815-07d0ab5a729b for instance 3a5a227f-6658-4f75-9193-65c781e2748f on hv-cinder-84327 Jun 16 00:35:19.070569 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-09860591-50bc-4c18-a049-2dd977484d14 req-d5760ff9-6443-4c3e-85c9-40e9331940db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027669 Jun 16 00:35:19.071126 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 436/895] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:20.066341 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-611f2413-cff1-46f9-93af-ec06817ee6ff tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:20.066889 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-611f2413-cff1-46f9-93af-ec06817ee6ff tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:20.073680 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-611f2413-cff1-46f9-93af-ec06817ee6ff tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:20.074129 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-611f2413-cff1-46f9-93af-ec06817ee6ff tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:20.074900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-611f2413-cff1-46f9-93af-ec06817ee6ff tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:20.075345 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-611f2413-cff1-46f9-93af-ec06817ee6ff tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:20.076893 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-49c0e221-7518-4376-aae5-0c5b4c6213c2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:20.077593 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-49c0e221-7518-4376-aae5-0c5b4c6213c2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:20.084287 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-49c0e221-7518-4376-aae5-0c5b4c6213c2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:20.084735 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-49c0e221-7518-4376-aae5-0c5b4c6213c2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:20.085515 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-49c0e221-7518-4376-aae5-0c5b4c6213c2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:20.085950 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-49c0e221-7518-4376-aae5-0c5b4c6213c2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:20.269402 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-49c0e221-7518-4376-aae5-0c5b4c6213c2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:20.272725 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-611f2413-cff1-46f9-93af-ec06817ee6ff tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:20.277518 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-49c0e221-7518-4376-aae5-0c5b4c6213c2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:20.279012 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-49c0e221-7518-4376-aae5-0c5b4c6213c2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:20.280206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-49c0e221-7518-4376-aae5-0c5b4c6213c2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1744 microversion: 2.20 time: 0.208127 Jun 16 00:35:20.280315 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-611f2413-cff1-46f9-93af-ec06817ee6ff tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1365 microversion: 2.1 time: 0.218394 Jun 16 00:35:20.280954 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 437/896] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:20 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1744 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:20.281080 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 460/897] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:20 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:21.085241 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-62d411e9-3447-4ece-8613-eaa22a43f7ee req-36c0cdb4-0704-4899-a6f6-f37107e707a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ebcc60-4082-48e9-8efa-dd22c7e01774", "name": "network-vif-plugged", "status": "completed", "tag": "e22ec279-19d4-4801-949d-a1ac3d959175"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:21.094653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-62d411e9-3447-4ece-8613-eaa22a43f7ee req-36c0cdb4-0704-4899-a6f6-f37107e707a0 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.095094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-62d411e9-3447-4ece-8613-eaa22a43f7ee req-36c0cdb4-0704-4899-a6f6-f37107e707a0 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.106201 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-62d411e9-3447-4ece-8613-eaa22a43f7ee req-36c0cdb4-0704-4899-a6f6-f37107e707a0 service nova] Creating event network-vif-plugged:e22ec279-19d4-4801-949d-a1ac3d959175 for instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 on hv-cinder-84327 Jun 16 00:35:21.111044 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-62d411e9-3447-4ece-8613-eaa22a43f7ee req-36c0cdb4-0704-4899-a6f6-f37107e707a0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030519 Jun 16 00:35:21.111655 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 438/898] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:21.296642 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-81ba3449-fff7-4510-922d-467c8b81c81e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:21.297244 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-81ba3449-fff7-4510-922d-467c8b81c81e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:21.298908 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-343e6ca6-93e4-43d1-87d4-aad687c1eda3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:21.299607 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-343e6ca6-93e4-43d1-87d4-aad687c1eda3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:21.304334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-81ba3449-fff7-4510-922d-467c8b81c81e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.304848 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-81ba3449-fff7-4510-922d-467c8b81c81e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.305683 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-81ba3449-fff7-4510-922d-467c8b81c81e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.306181 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-81ba3449-fff7-4510-922d-467c8b81c81e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.306389 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-343e6ca6-93e4-43d1-87d4-aad687c1eda3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.306847 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-343e6ca6-93e4-43d1-87d4-aad687c1eda3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.307639 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-343e6ca6-93e4-43d1-87d4-aad687c1eda3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.308183 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-343e6ca6-93e4-43d1-87d4-aad687c1eda3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.452085 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-343e6ca6-93e4-43d1-87d4-aad687c1eda3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:21.460932 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-343e6ca6-93e4-43d1-87d4-aad687c1eda3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:21.462439 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-343e6ca6-93e4-43d1-87d4-aad687c1eda3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:21.463636 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-343e6ca6-93e4-43d1-87d4-aad687c1eda3 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1744 microversion: 2.20 time: 0.169193 Jun 16 00:35:21.464198 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 439/899] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:21 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:21.589549 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-81ba3449-fff7-4510-922d-467c8b81c81e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:21.596894 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-81ba3449-fff7-4510-922d-467c8b81c81e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1365 microversion: 2.1 time: 0.304219 Jun 16 00:35:21.597436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 461/900] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:21 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:22.481775 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-170822e8-deb9-4f81-a758-8ad50a7a383d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:22.482381 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-170822e8-deb9-4f81-a758-8ad50a7a383d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:22.489360 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-170822e8-deb9-4f81-a758-8ad50a7a383d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.489813 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-170822e8-deb9-4f81-a758-8ad50a7a383d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.490575 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-170822e8-deb9-4f81-a758-8ad50a7a383d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.491011 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-170822e8-deb9-4f81-a758-8ad50a7a383d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.614036 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d4852b20-66ac-4016-9a3c-cdd3525fb34b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:22.614738 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d4852b20-66ac-4016-9a3c-cdd3525fb34b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:22.616469 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:22.617273 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=12 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:22.621134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-170822e8-deb9-4f81-a758-8ad50a7a383d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:22.628496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d4852b20-66ac-4016-9a3c-cdd3525fb34b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.628943 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d4852b20-66ac-4016-9a3c-cdd3525fb34b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.629712 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-170822e8-deb9-4f81-a758-8ad50a7a383d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:22.629867 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d4852b20-66ac-4016-9a3c-cdd3525fb34b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.630147 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d4852b20-66ac-4016-9a3c-cdd3525fb34b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.631197 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-170822e8-deb9-4f81-a758-8ad50a7a383d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:22.632380 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-170822e8-deb9-4f81-a758-8ad50a7a383d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1744 microversion: 2.20 time: 0.154497 Jun 16 00:35:22.632928 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 440/901] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:22 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:22.757890 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d4852b20-66ac-4016-9a3c-cdd3525fb34b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:22.765318 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d4852b20-66ac-4016-9a3c-cdd3525fb34b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1365 microversion: 2.1 time: 0.155679 Jun 16 00:35:22.765869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 462/902] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:22 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:23.650537 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c058bd9a-5fe2-4397-8ed8-7657df8479a4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:23.651124 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c058bd9a-5fe2-4397-8ed8-7657df8479a4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:23.653536 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=49 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:23.658800 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c058bd9a-5fe2-4397-8ed8-7657df8479a4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.659247 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c058bd9a-5fe2-4397-8ed8-7657df8479a4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.660046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c058bd9a-5fe2-4397-8ed8-7657df8479a4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.660490 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c058bd9a-5fe2-4397-8ed8-7657df8479a4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.782109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e9d960eb-3583-489c-8f9f-83478a65fb74 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:23.782852 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e9d960eb-3583-489c-8f9f-83478a65fb74 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:23.789994 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e9d960eb-3583-489c-8f9f-83478a65fb74 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.790570 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e9d960eb-3583-489c-8f9f-83478a65fb74 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.791228 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e9d960eb-3583-489c-8f9f-83478a65fb74 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.791662 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e9d960eb-3583-489c-8f9f-83478a65fb74 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.792990 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c058bd9a-5fe2-4397-8ed8-7657df8479a4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:23.802590 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c058bd9a-5fe2-4397-8ed8-7657df8479a4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:23.804130 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c058bd9a-5fe2-4397-8ed8-7657df8479a4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:23.805293 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c058bd9a-5fe2-4397-8ed8-7657df8479a4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1744 microversion: 2.20 time: 0.158691 Jun 16 00:35:23.805949 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 441/903] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:23 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:23.923894 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e9d960eb-3583-489c-8f9f-83478a65fb74 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:23.931200 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e9d960eb-3583-489c-8f9f-83478a65fb74 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1554 microversion: 2.1 time: 0.152905 Jun 16 00:35:23.931840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 463/904] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:23 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:23.947300 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ecd866f1-c66b-4e95-b447-b58917660a32 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:23.947822 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ecd866f1-c66b-4e95-b447-b58917660a32 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:23.954457 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ecd866f1-c66b-4e95-b447-b58917660a32 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.954909 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ecd866f1-c66b-4e95-b447-b58917660a32 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.956236 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ecd866f1-c66b-4e95-b447-b58917660a32 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.956678 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ecd866f1-c66b-4e95-b447-b58917660a32 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.035441 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ecd866f1-c66b-4e95-b447-b58917660a32 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091964 Jun 16 00:35:24.036059 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 442/905] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 16 00:35:23 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:24.823603 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4063459b-36ec-44e4-98c5-526adf1cc902 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:24.824229 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4063459b-36ec-44e4-98c5-526adf1cc902 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:24.832811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4063459b-36ec-44e4-98c5-526adf1cc902 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.833265 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4063459b-36ec-44e4-98c5-526adf1cc902 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.834050 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4063459b-36ec-44e4-98c5-526adf1cc902 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.834490 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4063459b-36ec-44e4-98c5-526adf1cc902 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:25.373435 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4063459b-36ec-44e4-98c5-526adf1cc902 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:25.384930 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4063459b-36ec-44e4-98c5-526adf1cc902 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:25.387308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4063459b-36ec-44e4-98c5-526adf1cc902 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:25.389329 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4063459b-36ec-44e4-98c5-526adf1cc902 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1739 microversion: 2.20 time: 0.569675 Jun 16 00:35:25.390031 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 464/906] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:24 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1739 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:25.468530 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-6925631d-bf05-434d-a705-11d75c51cc70 req-130b43be-e17a-4739-b9a2-f0938e23910d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0ebcc60-4082-48e9-8efa-dd22c7e01774", "tag": "e22ec279-19d4-4801-949d-a1ac3d959175"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:25.480336 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-6925631d-bf05-434d-a705-11d75c51cc70 req-130b43be-e17a-4739-b9a2-f0938e23910d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:25.481155 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-6925631d-bf05-434d-a705-11d75c51cc70 req-130b43be-e17a-4739-b9a2-f0938e23910d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:25.498863 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-6925631d-bf05-434d-a705-11d75c51cc70 req-130b43be-e17a-4739-b9a2-f0938e23910d service nova] Creating event network-changed:e22ec279-19d4-4801-949d-a1ac3d959175 for instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 on hv-cinder-84327 Jun 16 00:35:25.507761 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-6925631d-bf05-434d-a705-11d75c51cc70 req-130b43be-e17a-4739-b9a2-f0938e23910d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043249 Jun 16 00:35:25.508693 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 443/907] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:26.421349 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-57b8d491-ed9a-4e64-bc95-093db2a6ff70 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:26.422308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-57b8d491-ed9a-4e64-bc95-093db2a6ff70 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:26.426428 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:26.431696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-57b8d491-ed9a-4e64-bc95-093db2a6ff70 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:26.432203 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-57b8d491-ed9a-4e64-bc95-093db2a6ff70 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:26.432991 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-57b8d491-ed9a-4e64-bc95-093db2a6ff70 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:26.433425 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-57b8d491-ed9a-4e64-bc95-093db2a6ff70 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:26.582562 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-57b8d491-ed9a-4e64-bc95-093db2a6ff70 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:26.593042 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-57b8d491-ed9a-4e64-bc95-093db2a6ff70 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:26.594831 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-57b8d491-ed9a-4e64-bc95-093db2a6ff70 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:26.596195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-57b8d491-ed9a-4e64-bc95-093db2a6ff70 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1739 microversion: 2.20 time: 0.179990 Jun 16 00:35:26.596895 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 465/908] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:26 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:27.618069 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-fd41214b-2cf7-42d3-96c9-e5173790dcac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:27.618787 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-fd41214b-2cf7-42d3-96c9-e5173790dcac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:27.625085 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fd41214b-2cf7-42d3-96c9-e5173790dcac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:27.625542 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fd41214b-2cf7-42d3-96c9-e5173790dcac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:27.626318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fd41214b-2cf7-42d3-96c9-e5173790dcac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:27.626762 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fd41214b-2cf7-42d3-96c9-e5173790dcac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:27.788932 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fd41214b-2cf7-42d3-96c9-e5173790dcac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:27.797531 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fd41214b-2cf7-42d3-96c9-e5173790dcac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:27.800010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fd41214b-2cf7-42d3-96c9-e5173790dcac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:27.801505 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-fd41214b-2cf7-42d3-96c9-e5173790dcac tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1739 microversion: 2.20 time: 0.188315 Jun 16 00:35:27.812422 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 444/909] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:27 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:28.819970 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-602d992b-9da1-47fa-883b-afe56b64da7a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:28.821478 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-602d992b-9da1-47fa-883b-afe56b64da7a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:28.828633 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-602d992b-9da1-47fa-883b-afe56b64da7a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:28.829406 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-602d992b-9da1-47fa-883b-afe56b64da7a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:28.830396 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-602d992b-9da1-47fa-883b-afe56b64da7a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:28.830874 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-602d992b-9da1-47fa-883b-afe56b64da7a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:28.968933 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-602d992b-9da1-47fa-883b-afe56b64da7a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:28.979412 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-602d992b-9da1-47fa-883b-afe56b64da7a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:28.981018 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-602d992b-9da1-47fa-883b-afe56b64da7a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:28.982342 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-602d992b-9da1-47fa-883b-afe56b64da7a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1739 microversion: 2.20 time: 0.166422 Jun 16 00:35:28.982856 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 466/910] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:28 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:30.001262 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e08f0ca8-fe5b-4108-8c39-4d09f03df78a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:30.002564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e08f0ca8-fe5b-4108-8c39-4d09f03df78a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:30.009604 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e08f0ca8-fe5b-4108-8c39-4d09f03df78a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:30.010068 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e08f0ca8-fe5b-4108-8c39-4d09f03df78a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:30.010853 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e08f0ca8-fe5b-4108-8c39-4d09f03df78a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:30.011295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e08f0ca8-fe5b-4108-8c39-4d09f03df78a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:30.158426 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e08f0ca8-fe5b-4108-8c39-4d09f03df78a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:30.167552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e08f0ca8-fe5b-4108-8c39-4d09f03df78a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:30.169247 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e08f0ca8-fe5b-4108-8c39-4d09f03df78a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:30.170640 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e08f0ca8-fe5b-4108-8c39-4d09f03df78a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1739 microversion: 2.20 time: 0.173254 Jun 16 00:35:30.171478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 445/911] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:29 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:31.189943 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3749b46c-0054-4eca-a261-a44317e31740 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:31.190864 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-3749b46c-0054-4eca-a261-a44317e31740 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:31.197923 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3749b46c-0054-4eca-a261-a44317e31740 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:31.198498 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3749b46c-0054-4eca-a261-a44317e31740 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:31.199367 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3749b46c-0054-4eca-a261-a44317e31740 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:31.200017 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3749b46c-0054-4eca-a261-a44317e31740 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:31.340614 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3749b46c-0054-4eca-a261-a44317e31740 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:31.349018 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3749b46c-0054-4eca-a261-a44317e31740 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:31.350516 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3749b46c-0054-4eca-a261-a44317e31740 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:31.351725 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3749b46c-0054-4eca-a261-a44317e31740 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1739 microversion: 2.20 time: 0.166241 Jun 16 00:35:31.352298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 467/912] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:31 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:32.373021 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-89ae8cf4-d87b-4d9b-82f7-6c02b8b35545 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:32.374420 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-89ae8cf4-d87b-4d9b-82f7-6c02b8b35545 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:32.381447 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89ae8cf4-d87b-4d9b-82f7-6c02b8b35545 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:32.383757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89ae8cf4-d87b-4d9b-82f7-6c02b8b35545 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:32.384649 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89ae8cf4-d87b-4d9b-82f7-6c02b8b35545 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:32.385183 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89ae8cf4-d87b-4d9b-82f7-6c02b8b35545 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:32.523684 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-89ae8cf4-d87b-4d9b-82f7-6c02b8b35545 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:32.532003 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-89ae8cf4-d87b-4d9b-82f7-6c02b8b35545 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:32.534792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-89ae8cf4-d87b-4d9b-82f7-6c02b8b35545 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:32.534792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-89ae8cf4-d87b-4d9b-82f7-6c02b8b35545 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1739 microversion: 2.20 time: 0.165936 Jun 16 00:35:32.535524 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 446/913] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:32 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:33.553765 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-caca4328-10af-492c-8376-08d7f739cc76 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:33.554412 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-caca4328-10af-492c-8376-08d7f739cc76 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:33.561157 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-caca4328-10af-492c-8376-08d7f739cc76 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:33.561611 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-caca4328-10af-492c-8376-08d7f739cc76 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:33.562379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-caca4328-10af-492c-8376-08d7f739cc76 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:33.562821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-caca4328-10af-492c-8376-08d7f739cc76 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:33.715958 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-caca4328-10af-492c-8376-08d7f739cc76 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:33.724947 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-caca4328-10af-492c-8376-08d7f739cc76 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:33.726715 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-caca4328-10af-492c-8376-08d7f739cc76 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:33.727837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-caca4328-10af-492c-8376-08d7f739cc76 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1739 microversion: 2.20 time: 0.178508 Jun 16 00:35:33.728729 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 468/914] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:33 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:34.747495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-99b93d9d-2097-4398-ba13-35388406e6a9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:34.748066 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-99b93d9d-2097-4398-ba13-35388406e6a9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:34.755255 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99b93d9d-2097-4398-ba13-35388406e6a9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:34.755737 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99b93d9d-2097-4398-ba13-35388406e6a9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:34.756500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99b93d9d-2097-4398-ba13-35388406e6a9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:34.756935 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99b93d9d-2097-4398-ba13-35388406e6a9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:34.888838 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-99b93d9d-2097-4398-ba13-35388406e6a9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:34.897043 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-99b93d9d-2097-4398-ba13-35388406e6a9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:34.898612 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-99b93d9d-2097-4398-ba13-35388406e6a9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:34.899795 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-99b93d9d-2097-4398-ba13-35388406e6a9 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1739 microversion: 2.20 time: 0.156208 Jun 16 00:35:34.900349 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 447/915] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:34 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:35.918561 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c6000d04-1f69-49f9-8c32-68d5765640e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:35.919162 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c6000d04-1f69-49f9-8c32-68d5765640e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:35.926396 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c6000d04-1f69-49f9-8c32-68d5765640e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:35.926856 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c6000d04-1f69-49f9-8c32-68d5765640e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:35.927660 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c6000d04-1f69-49f9-8c32-68d5765640e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:35.928109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c6000d04-1f69-49f9-8c32-68d5765640e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:36.057445 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c6000d04-1f69-49f9-8c32-68d5765640e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:36.065951 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c6000d04-1f69-49f9-8c32-68d5765640e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:36.067485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c6000d04-1f69-49f9-8c32-68d5765640e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:36.068643 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c6000d04-1f69-49f9-8c32-68d5765640e8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1721 microversion: 2.20 time: 0.153996 Jun 16 00:35:36.069192 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 469/916] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:35 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:37.086321 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b87ffb2f-9cf1-4680-af12-4c5b1eefec00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:37.086854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b87ffb2f-9cf1-4680-af12-4c5b1eefec00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:37.093329 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b87ffb2f-9cf1-4680-af12-4c5b1eefec00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:37.093782 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b87ffb2f-9cf1-4680-af12-4c5b1eefec00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:37.094541 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b87ffb2f-9cf1-4680-af12-4c5b1eefec00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:37.094979 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b87ffb2f-9cf1-4680-af12-4c5b1eefec00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:37.222736 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b87ffb2f-9cf1-4680-af12-4c5b1eefec00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:37.230568 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b87ffb2f-9cf1-4680-af12-4c5b1eefec00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:37.232079 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b87ffb2f-9cf1-4680-af12-4c5b1eefec00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:37.233218 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b87ffb2f-9cf1-4680-af12-4c5b1eefec00 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1721 microversion: 2.20 time: 0.150906 Jun 16 00:35:37.233759 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 448/917] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:37 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:38.114456 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3c7ffb19-4998-4e6b-8117-aff25f53b2c4 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:38.114974 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-3c7ffb19-4998-4e6b-8117-aff25f53b2c4 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:38.121401 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3c7ffb19-4998-4e6b-8117-aff25f53b2c4 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.121847 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3c7ffb19-4998-4e6b-8117-aff25f53b2c4 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.122598 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3c7ffb19-4998-4e6b-8117-aff25f53b2c4 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.123027 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3c7ffb19-4998-4e6b-8117-aff25f53b2c4 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.145910 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3c7ffb19-4998-4e6b-8117-aff25f53b2c4 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/ips" status: 200 len: 145 microversion: 2.1 time: 0.035875 Jun 16 00:35:38.146448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 470/918] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 16 00:35:38 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:38.252432 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1008e1ba-695f-4781-9a78-e55e8fdf988d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:38.253073 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1008e1ba-695f-4781-9a78-e55e8fdf988d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:38.259503 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1008e1ba-695f-4781-9a78-e55e8fdf988d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.259987 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1008e1ba-695f-4781-9a78-e55e8fdf988d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.260745 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1008e1ba-695f-4781-9a78-e55e8fdf988d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.261176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1008e1ba-695f-4781-9a78-e55e8fdf988d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.387243 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1008e1ba-695f-4781-9a78-e55e8fdf988d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:38.395435 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1008e1ba-695f-4781-9a78-e55e8fdf988d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:38.396976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1008e1ba-695f-4781-9a78-e55e8fdf988d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:38.398161 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1008e1ba-695f-4781-9a78-e55e8fdf988d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1664 microversion: 2.20 time: 0.150326 Jun 16 00:35:38.398714 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 449/919] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:38 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:38.415959 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-61d7033f-a6f4-4824-8f0a-531594163083 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a52f4f1b-5f55-4a03-878b-1a496c7a3f27"}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:38.417008 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-61d7033f-a6f4-4824-8f0a-531594163083 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:38.422868 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-61d7033f-a6f4-4824-8f0a-531594163083 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.423311 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-61d7033f-a6f4-4824-8f0a-531594163083 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.424600 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-61d7033f-a6f4-4824-8f0a-531594163083 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.425128 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-61d7033f-a6f4-4824-8f0a-531594163083 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.691644 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-61d7033f-a6f4-4824-8f0a-531594163083 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "POST /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.279629 Jun 16 00:35:38.692282 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 471/920] 10.222.0.44 () {62 vars in 1363 bytes} [Thu Jun 16 00:35:38 2022] POST /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/os-volume_attachments => generated 188 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:35:38.805193 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5b981fc1-7e63-49d2-9f07-cdbc6da0e896 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:38.805681 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5b981fc1-7e63-49d2-9f07-cdbc6da0e896 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:38.811577 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5b981fc1-7e63-49d2-9f07-cdbc6da0e896 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.812134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5b981fc1-7e63-49d2-9f07-cdbc6da0e896 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.813091 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5b981fc1-7e63-49d2-9f07-cdbc6da0e896 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.813529 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5b981fc1-7e63-49d2-9f07-cdbc6da0e896 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.879768 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-930b290c-97c2-4887-882f-19913f1b93ea req-06d780b3-dfeb-46f4-b8ae-fa3e5eb30754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5a227f-6658-4f75-9193-65c781e2748f", "name": "network-vif-unplugged", "status": "completed", "tag": "c16f9b3b-e924-4296-9815-07d0ab5a729b"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:38.888878 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-930b290c-97c2-4887-882f-19913f1b93ea req-06d780b3-dfeb-46f4-b8ae-fa3e5eb30754 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.889489 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-930b290c-97c2-4887-882f-19913f1b93ea req-06d780b3-dfeb-46f4-b8ae-fa3e5eb30754 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.894873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:38.902216 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.compute.server_external_events [req-930b290c-97c2-4887-882f-19913f1b93ea req-06d780b3-dfeb-46f4-b8ae-fa3e5eb30754 service nova] Unable to find a host for instance 3a5a227f-6658-4f75-9193-65c781e2748f. Dropping event network-vif-unplugged {{(pid=129466) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 00:35:38.903148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-930b290c-97c2-4887-882f-19913f1b93ea req-06d780b3-dfeb-46f4-b8ae-fa3e5eb30754 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027356 Jun 16 00:35:38.903912 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 472/921] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 00:35:38.915189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:39.061480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5b981fc1-7e63-49d2-9f07-cdbc6da0e896 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/os-volume_attachments/a52f4f1b-5f55-4a03-878b-1a496c7a3f27" status: 202 len: 0 microversion: 2.20 time: 0.260330 Jun 16 00:35:39.062072 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 450/922] 10.222.0.44 () {60 vars in 1456 bytes} [Thu Jun 16 00:35:38 2022] DELETE /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/os-volume_attachments/a52f4f1b-5f55-4a03-878b-1a496c7a3f27 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:35:39.118944 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0f1de1f1-f612-490b-bd47-8132c99209f8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:39.119525 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0f1de1f1-f612-490b-bd47-8132c99209f8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:39.126595 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0f1de1f1-f612-490b-bd47-8132c99209f8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.127068 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0f1de1f1-f612-490b-bd47-8132c99209f8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.127866 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0f1de1f1-f612-490b-bd47-8132c99209f8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.128311 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0f1de1f1-f612-490b-bd47-8132c99209f8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.215627 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0f1de1f1-f612-490b-bd47-8132c99209f8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "POST /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/action" status: 202 len: 0 microversion: 2.20 time: 0.101330 Jun 16 00:35:39.216355 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 473/923] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jun 16 00:35:39 2022] POST /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:35:39.224889 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9ed0d3ec-7ed8-4bef-b1d6-3d18ac98571b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:39.225501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9ed0d3ec-7ed8-4bef-b1d6-3d18ac98571b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:39.231569 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9ed0d3ec-7ed8-4bef-b1d6-3d18ac98571b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.232049 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9ed0d3ec-7ed8-4bef-b1d6-3d18ac98571b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.232820 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9ed0d3ec-7ed8-4bef-b1d6-3d18ac98571b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.233257 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9ed0d3ec-7ed8-4bef-b1d6-3d18ac98571b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.405781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9ed0d3ec-7ed8-4bef-b1d6-3d18ac98571b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:39.413760 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9ed0d3ec-7ed8-4bef-b1d6-3d18ac98571b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:39.415255 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9ed0d3ec-7ed8-4bef-b1d6-3d18ac98571b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:39.416448 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9ed0d3ec-7ed8-4bef-b1d6-3d18ac98571b tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1672 microversion: 2.20 time: 0.195976 Jun 16 00:35:39.417004 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 451/924] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:39 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:40.435182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a0087d68-bc14-41a9-b93c-908dcf0760f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:40.435844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a0087d68-bc14-41a9-b93c-908dcf0760f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:40.443195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a0087d68-bc14-41a9-b93c-908dcf0760f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:40.443669 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a0087d68-bc14-41a9-b93c-908dcf0760f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:40.444452 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a0087d68-bc14-41a9-b93c-908dcf0760f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:40.444894 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a0087d68-bc14-41a9-b93c-908dcf0760f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:40.578433 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a0087d68-bc14-41a9-b93c-908dcf0760f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:40.586503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a0087d68-bc14-41a9-b93c-908dcf0760f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:40.588046 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a0087d68-bc14-41a9-b93c-908dcf0760f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:40.589231 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a0087d68-bc14-41a9-b93c-908dcf0760f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.158551 Jun 16 00:35:40.589789 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 474/925] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:40 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:40.992221 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6d273153-6cea-49f5-8d4d-33beb834ac2f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76be2891-772e-47e8-93fb-1ba953ff8ffc"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:40.993346 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6d273153-6cea-49f5-8d4d-33beb834ac2f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:40.999863 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6d273153-6cea-49f5-8d4d-33beb834ac2f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:41.000320 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6d273153-6cea-49f5-8d4d-33beb834ac2f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:41.001094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6d273153-6cea-49f5-8d4d-33beb834ac2f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:41.001537 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6d273153-6cea-49f5-8d4d-33beb834ac2f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:41.335317 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6d273153-6cea-49f5-8d4d-33beb834ac2f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "POST /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345905 Jun 16 00:35:41.344952 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 452/926] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:35:40 2022] POST /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:41.607875 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c1d34c39-3c8e-4a95-86fe-8597997e85f6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:41.608490 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c1d34c39-3c8e-4a95-86fe-8597997e85f6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:41.615080 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c1d34c39-3c8e-4a95-86fe-8597997e85f6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:41.615536 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c1d34c39-3c8e-4a95-86fe-8597997e85f6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:41.616339 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c1d34c39-3c8e-4a95-86fe-8597997e85f6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:41.616782 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c1d34c39-3c8e-4a95-86fe-8597997e85f6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:41.755690 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c1d34c39-3c8e-4a95-86fe-8597997e85f6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:41.764429 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c1d34c39-3c8e-4a95-86fe-8597997e85f6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:41.766174 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c1d34c39-3c8e-4a95-86fe-8597997e85f6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:41.768307 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c1d34c39-3c8e-4a95-86fe-8597997e85f6 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.163722 Jun 16 00:35:41.769182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 475/927] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:41 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:42.788345 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f0f39487-9807-4291-bec7-a54d14126437 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:42.789050 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f0f39487-9807-4291-bec7-a54d14126437 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:42.795318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f0f39487-9807-4291-bec7-a54d14126437 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:42.795811 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f0f39487-9807-4291-bec7-a54d14126437 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:42.796647 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f0f39487-9807-4291-bec7-a54d14126437 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:42.797082 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f0f39487-9807-4291-bec7-a54d14126437 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:42.927639 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f0f39487-9807-4291-bec7-a54d14126437 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:42.935642 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f0f39487-9807-4291-bec7-a54d14126437 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:42.937156 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f0f39487-9807-4291-bec7-a54d14126437 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:42.938319 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f0f39487-9807-4291-bec7-a54d14126437 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.155475 Jun 16 00:35:42.938877 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 453/928] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:42 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:43.956264 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1aaa279c-6bf8-49f2-bc93-dd18aff2dfdf tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:43.956890 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1aaa279c-6bf8-49f2-bc93-dd18aff2dfdf tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:43.963120 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1aaa279c-6bf8-49f2-bc93-dd18aff2dfdf tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:43.963571 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1aaa279c-6bf8-49f2-bc93-dd18aff2dfdf tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:43.964371 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1aaa279c-6bf8-49f2-bc93-dd18aff2dfdf tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:43.964809 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1aaa279c-6bf8-49f2-bc93-dd18aff2dfdf tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:44.109370 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1aaa279c-6bf8-49f2-bc93-dd18aff2dfdf tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:44.118351 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1aaa279c-6bf8-49f2-bc93-dd18aff2dfdf tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:44.119858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1aaa279c-6bf8-49f2-bc93-dd18aff2dfdf tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:44.121017 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1aaa279c-6bf8-49f2-bc93-dd18aff2dfdf tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.168645 Jun 16 00:35:44.121564 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 476/929] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:43 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:45.145293 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2fedaed9-917f-4ca5-896d-f658253e4df4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:45.145976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2fedaed9-917f-4ca5-896d-f658253e4df4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:45.160784 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2fedaed9-917f-4ca5-896d-f658253e4df4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:45.161579 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2fedaed9-917f-4ca5-896d-f658253e4df4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:45.162527 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2fedaed9-917f-4ca5-896d-f658253e4df4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:45.164363 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2fedaed9-917f-4ca5-896d-f658253e4df4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:45.294023 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2fedaed9-917f-4ca5-896d-f658253e4df4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:45.302775 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2fedaed9-917f-4ca5-896d-f658253e4df4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:45.304310 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2fedaed9-917f-4ca5-896d-f658253e4df4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:45.305480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2fedaed9-917f-4ca5-896d-f658253e4df4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.164696 Jun 16 00:35:45.306045 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 454/930] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:45 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:46.325226 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8aefecfd-7112-47d2-bb31-c15378a86c86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:46.325868 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8aefecfd-7112-47d2-bb31-c15378a86c86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:46.332939 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8aefecfd-7112-47d2-bb31-c15378a86c86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:46.333391 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8aefecfd-7112-47d2-bb31-c15378a86c86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:46.334153 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8aefecfd-7112-47d2-bb31-c15378a86c86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:46.334585 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8aefecfd-7112-47d2-bb31-c15378a86c86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:46.466182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8aefecfd-7112-47d2-bb31-c15378a86c86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:46.483645 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8aefecfd-7112-47d2-bb31-c15378a86c86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:46.483645 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8aefecfd-7112-47d2-bb31-c15378a86c86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:46.483645 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8aefecfd-7112-47d2-bb31-c15378a86c86 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.161425 Jun 16 00:35:46.495897 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 477/931] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:46 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:47.504872 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6fab1739-e769-4782-b06c-c0ea5498bf29 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:47.505728 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6fab1739-e769-4782-b06c-c0ea5498bf29 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:47.514632 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6fab1739-e769-4782-b06c-c0ea5498bf29 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:47.515238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6fab1739-e769-4782-b06c-c0ea5498bf29 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:47.516109 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6fab1739-e769-4782-b06c-c0ea5498bf29 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:47.516548 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6fab1739-e769-4782-b06c-c0ea5498bf29 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:47.653573 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6fab1739-e769-4782-b06c-c0ea5498bf29 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:47.661972 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6fab1739-e769-4782-b06c-c0ea5498bf29 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:47.663468 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6fab1739-e769-4782-b06c-c0ea5498bf29 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:47.664661 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6fab1739-e769-4782-b06c-c0ea5498bf29 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.165839 Jun 16 00:35:47.665214 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 455/932] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:47 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:48.683888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-14853b0b-a7c0-4217-8a50-2d9ec9c6ca67 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:48.684503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-14853b0b-a7c0-4217-8a50-2d9ec9c6ca67 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:48.691764 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-14853b0b-a7c0-4217-8a50-2d9ec9c6ca67 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:48.692214 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-14853b0b-a7c0-4217-8a50-2d9ec9c6ca67 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:48.693003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-14853b0b-a7c0-4217-8a50-2d9ec9c6ca67 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:48.693467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-14853b0b-a7c0-4217-8a50-2d9ec9c6ca67 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:48.866835 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-14853b0b-a7c0-4217-8a50-2d9ec9c6ca67 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:48.875310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-14853b0b-a7c0-4217-8a50-2d9ec9c6ca67 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:48.877013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-14853b0b-a7c0-4217-8a50-2d9ec9c6ca67 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:48.878395 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-14853b0b-a7c0-4217-8a50-2d9ec9c6ca67 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.198436 Jun 16 00:35:48.879190 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 478/933] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:48 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:49.898163 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f539c7cd-9abc-4a55-8072-e92d99b87bb0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:49.900016 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f539c7cd-9abc-4a55-8072-e92d99b87bb0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:49.922893 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f539c7cd-9abc-4a55-8072-e92d99b87bb0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:49.923585 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f539c7cd-9abc-4a55-8072-e92d99b87bb0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:49.924562 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f539c7cd-9abc-4a55-8072-e92d99b87bb0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:49.925153 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f539c7cd-9abc-4a55-8072-e92d99b87bb0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:50.075696 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f539c7cd-9abc-4a55-8072-e92d99b87bb0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:50.087550 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f539c7cd-9abc-4a55-8072-e92d99b87bb0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:50.089205 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f539c7cd-9abc-4a55-8072-e92d99b87bb0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:50.090624 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f539c7cd-9abc-4a55-8072-e92d99b87bb0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.197013 Jun 16 00:35:50.091542 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 456/934] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:49 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:51.108903 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e9cb7246-fbb9-4d1a-9a53-6de347597c93 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:51.109849 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e9cb7246-fbb9-4d1a-9a53-6de347597c93 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:51.117134 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e9cb7246-fbb9-4d1a-9a53-6de347597c93 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:51.117853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e9cb7246-fbb9-4d1a-9a53-6de347597c93 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:51.118775 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e9cb7246-fbb9-4d1a-9a53-6de347597c93 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:51.122865 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e9cb7246-fbb9-4d1a-9a53-6de347597c93 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:51.395971 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e9cb7246-fbb9-4d1a-9a53-6de347597c93 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:51.413193 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e9cb7246-fbb9-4d1a-9a53-6de347597c93 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:51.429473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e9cb7246-fbb9-4d1a-9a53-6de347597c93 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:51.441177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e9cb7246-fbb9-4d1a-9a53-6de347597c93 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.336138 Jun 16 00:35:51.452357 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 479/935] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:51 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:51.661917 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-27f62765-00e5-4c66-a178-8cba58a89419 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:51.662438 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-27f62765-00e5-4c66-a178-8cba58a89419 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:51.666441 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-06f241f3-69b8-4346-b56c-6597951165e5 req-cdd7f6b2-2eb8-49cb-a367-62c634e8179c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb151dc-a559-4ad5-9a4f-c55e2609758f", "tag": "bf8752fe-370d-4c67-8d58-5ab0ba31fdc9"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:51.669115 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-27f62765-00e5-4c66-a178-8cba58a89419 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:51.669568 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-27f62765-00e5-4c66-a178-8cba58a89419 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:51.670517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-27f62765-00e5-4c66-a178-8cba58a89419 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:51.670953 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-27f62765-00e5-4c66-a178-8cba58a89419 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:51.676331 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-06f241f3-69b8-4346-b56c-6597951165e5 req-cdd7f6b2-2eb8-49cb-a367-62c634e8179c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:51.676861 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-06f241f3-69b8-4346-b56c-6597951165e5 req-cdd7f6b2-2eb8-49cb-a367-62c634e8179c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:51.689468 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-06f241f3-69b8-4346-b56c-6597951165e5 req-cdd7f6b2-2eb8-49cb-a367-62c634e8179c service nova] Creating event network-changed:bf8752fe-370d-4c67-8d58-5ab0ba31fdc9 for instance ebb151dc-a559-4ad5-9a4f-c55e2609758f on hv-cinder-84327 Jun 16 00:35:51.694912 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-06f241f3-69b8-4346-b56c-6597951165e5 req-cdd7f6b2-2eb8-49cb-a367-62c634e8179c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033005 Jun 16 00:35:51.696016 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 480/936] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:51.699370 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-27f62765-00e5-4c66-a178-8cba58a89419 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Going to try to terminate instance {{(pid=129465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:35:51.777145 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-27f62765-00e5-4c66-a178-8cba58a89419 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 204 len: 0 microversion: 2.1 time: 0.120133 Jun 16 00:35:51.777742 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 457/937] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:35:51 2022] DELETE /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:35:51.790311 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-74685c4d-4847-4511-8940-73f88f6c9ffc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:51.791192 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-74685c4d-4847-4511-8940-73f88f6c9ffc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:51.797437 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-74685c4d-4847-4511-8940-73f88f6c9ffc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:51.798522 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-74685c4d-4847-4511-8940-73f88f6c9ffc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:51.799301 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-74685c4d-4847-4511-8940-73f88f6c9ffc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:51.799790 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-74685c4d-4847-4511-8940-73f88f6c9ffc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:52.005701 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-74685c4d-4847-4511-8940-73f88f6c9ffc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:52.013510 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-74685c4d-4847-4511-8940-73f88f6c9ffc tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.231011 Jun 16 00:35:52.014313 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 481/938] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:51 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:52.460357 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5e9e779a-38f8-4667-9007-3a175a85439d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:52.461060 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5e9e779a-38f8-4667-9007-3a175a85439d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:52.467323 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5e9e779a-38f8-4667-9007-3a175a85439d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:52.467811 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5e9e779a-38f8-4667-9007-3a175a85439d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:52.468579 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5e9e779a-38f8-4667-9007-3a175a85439d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:52.469013 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5e9e779a-38f8-4667-9007-3a175a85439d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:52.602222 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5e9e779a-38f8-4667-9007-3a175a85439d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:52.610314 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5e9e779a-38f8-4667-9007-3a175a85439d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:52.612518 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5e9e779a-38f8-4667-9007-3a175a85439d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:52.613761 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5e9e779a-38f8-4667-9007-3a175a85439d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.157831 Jun 16 00:35:52.614407 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 458/939] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:52 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:53.031502 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ee76486a-57ba-46cc-b40c-7a188024ea92 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:53.032129 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ee76486a-57ba-46cc-b40c-7a188024ea92 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:53.039049 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ee76486a-57ba-46cc-b40c-7a188024ea92 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:53.039492 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ee76486a-57ba-46cc-b40c-7a188024ea92 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:53.040305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ee76486a-57ba-46cc-b40c-7a188024ea92 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:53.040741 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ee76486a-57ba-46cc-b40c-7a188024ea92 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:53.193944 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ee76486a-57ba-46cc-b40c-7a188024ea92 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:53.202358 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ee76486a-57ba-46cc-b40c-7a188024ea92 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.174686 Jun 16 00:35:53.203258 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 482/940] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:53 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:53.632440 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ebfd18d6-5238-4966-bae2-786591f19d5e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:53.633091 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ebfd18d6-5238-4966-bae2-786591f19d5e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:53.639552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ebfd18d6-5238-4966-bae2-786591f19d5e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:53.640020 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ebfd18d6-5238-4966-bae2-786591f19d5e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:53.640817 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ebfd18d6-5238-4966-bae2-786591f19d5e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:53.641249 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ebfd18d6-5238-4966-bae2-786591f19d5e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:53.769978 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ebfd18d6-5238-4966-bae2-786591f19d5e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:53.777743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ebfd18d6-5238-4966-bae2-786591f19d5e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:53.779221 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ebfd18d6-5238-4966-bae2-786591f19d5e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:53.780384 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ebfd18d6-5238-4966-bae2-786591f19d5e tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.151880 Jun 16 00:35:53.780935 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 459/941] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:53 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:54.219490 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2eb61400-03fe-461b-9207-66ee07e51d81 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:54.220126 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2eb61400-03fe-461b-9207-66ee07e51d81 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:54.226632 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2eb61400-03fe-461b-9207-66ee07e51d81 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:54.227080 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2eb61400-03fe-461b-9207-66ee07e51d81 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:54.227876 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2eb61400-03fe-461b-9207-66ee07e51d81 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:54.228314 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2eb61400-03fe-461b-9207-66ee07e51d81 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:54.361104 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2eb61400-03fe-461b-9207-66ee07e51d81 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:54.368667 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2eb61400-03fe-461b-9207-66ee07e51d81 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.152975 Jun 16 00:35:54.369239 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 483/942] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:54 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:54.798266 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2aacb9f6-1488-4702-b886-adc310f4b0c8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:54.798875 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2aacb9f6-1488-4702-b886-adc310f4b0c8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:54.802176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:54.808249 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2aacb9f6-1488-4702-b886-adc310f4b0c8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:54.808703 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2aacb9f6-1488-4702-b886-adc310f4b0c8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:54.809476 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2aacb9f6-1488-4702-b886-adc310f4b0c8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:54.809908 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2aacb9f6-1488-4702-b886-adc310f4b0c8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:54.936734 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2aacb9f6-1488-4702-b886-adc310f4b0c8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:54.944586 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2aacb9f6-1488-4702-b886-adc310f4b0c8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:54.946070 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2aacb9f6-1488-4702-b886-adc310f4b0c8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:54.947218 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2aacb9f6-1488-4702-b886-adc310f4b0c8 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.152924 Jun 16 00:35:54.947830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 460/943] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:54 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:55.386054 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6866b394-13db-40b0-9a9a-d658c34044f7 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:55.386652 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-6866b394-13db-40b0-9a9a-d658c34044f7 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:55.393240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6866b394-13db-40b0-9a9a-d658c34044f7 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:55.393935 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6866b394-13db-40b0-9a9a-d658c34044f7 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:55.394689 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6866b394-13db-40b0-9a9a-d658c34044f7 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:55.395117 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6866b394-13db-40b0-9a9a-d658c34044f7 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:55.523056 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-6866b394-13db-40b0-9a9a-d658c34044f7 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:55.530947 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-6866b394-13db-40b0-9a9a-d658c34044f7 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.148761 Jun 16 00:35:55.531499 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 484/944] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:55 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:55.965616 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2b211c30-f532-4b9c-a592-080ed47e785d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:55.966227 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2b211c30-f532-4b9c-a592-080ed47e785d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:55.973427 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2b211c30-f532-4b9c-a592-080ed47e785d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:55.973877 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2b211c30-f532-4b9c-a592-080ed47e785d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:55.974637 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2b211c30-f532-4b9c-a592-080ed47e785d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:55.975074 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2b211c30-f532-4b9c-a592-080ed47e785d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:56.103974 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2b211c30-f532-4b9c-a592-080ed47e785d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:56.112441 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2b211c30-f532-4b9c-a592-080ed47e785d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:56.113938 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2b211c30-f532-4b9c-a592-080ed47e785d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:56.115094 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2b211c30-f532-4b9c-a592-080ed47e785d tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.153435 Jun 16 00:35:56.115681 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 461/945] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:55 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:56.547394 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-bdc9e45c-9a6b-4e7a-be77-a2a606dbe654 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:56.548051 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-bdc9e45c-9a6b-4e7a-be77-a2a606dbe654 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:56.550641 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=42 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:56.555905 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bdc9e45c-9a6b-4e7a-be77-a2a606dbe654 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:56.556350 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bdc9e45c-9a6b-4e7a-be77-a2a606dbe654 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:56.557107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bdc9e45c-9a6b-4e7a-be77-a2a606dbe654 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:56.557538 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bdc9e45c-9a6b-4e7a-be77-a2a606dbe654 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:56.686432 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-bdc9e45c-9a6b-4e7a-be77-a2a606dbe654 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:56.694976 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-bdc9e45c-9a6b-4e7a-be77-a2a606dbe654 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.151404 Jun 16 00:35:56.695542 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 485/946] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:56 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:57.133495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2dc6cb7f-a0be-4ca6-b589-241cc6aaa5f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:57.134057 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2dc6cb7f-a0be-4ca6-b589-241cc6aaa5f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:57.140560 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2dc6cb7f-a0be-4ca6-b589-241cc6aaa5f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:57.141016 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2dc6cb7f-a0be-4ca6-b589-241cc6aaa5f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:57.142302 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2dc6cb7f-a0be-4ca6-b589-241cc6aaa5f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:57.142741 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2dc6cb7f-a0be-4ca6-b589-241cc6aaa5f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:57.279577 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2dc6cb7f-a0be-4ca6-b589-241cc6aaa5f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:57.288571 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2dc6cb7f-a0be-4ca6-b589-241cc6aaa5f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:57.290075 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2dc6cb7f-a0be-4ca6-b589-241cc6aaa5f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:57.291231 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2dc6cb7f-a0be-4ca6-b589-241cc6aaa5f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.161743 Jun 16 00:35:57.292136 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 462/947] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:57 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:57.712749 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a2862917-2555-4db1-8305-9f06294d649b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:57.713567 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a2862917-2555-4db1-8305-9f06294d649b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:57.720328 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a2862917-2555-4db1-8305-9f06294d649b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:57.720784 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a2862917-2555-4db1-8305-9f06294d649b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:57.721555 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a2862917-2555-4db1-8305-9f06294d649b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:57.721996 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a2862917-2555-4db1-8305-9f06294d649b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:57.849812 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a2862917-2555-4db1-8305-9f06294d649b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:57.857246 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a2862917-2555-4db1-8305-9f06294d649b tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.148342 Jun 16 00:35:57.857788 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 486/948] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:57 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:58.309924 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-897cad20-a316-40b6-9342-6d0fab1bf23c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:58.313777 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-897cad20-a316-40b6-9342-6d0fab1bf23c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:58.321351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-897cad20-a316-40b6-9342-6d0fab1bf23c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:58.322198 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-897cad20-a316-40b6-9342-6d0fab1bf23c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:58.323215 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-897cad20-a316-40b6-9342-6d0fab1bf23c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:58.324029 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-897cad20-a316-40b6-9342-6d0fab1bf23c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:58.330131 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:INSERT=3,nova_cell1:SELECT=90 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:58.453465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-897cad20-a316-40b6-9342-6d0fab1bf23c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:58.461814 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-897cad20-a316-40b6-9342-6d0fab1bf23c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:58.463300 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-897cad20-a316-40b6-9342-6d0fab1bf23c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:58.464472 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-897cad20-a316-40b6-9342-6d0fab1bf23c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.158510 Jun 16 00:35:58.465028 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 463/949] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:58 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:58.874706 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1cd62c02-f47d-42ec-88d5-531722c10db2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:58.875324 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1cd62c02-f47d-42ec-88d5-531722c10db2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:58.881886 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1cd62c02-f47d-42ec-88d5-531722c10db2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:58.882340 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1cd62c02-f47d-42ec-88d5-531722c10db2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:58.883108 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1cd62c02-f47d-42ec-88d5-531722c10db2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:58.883544 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1cd62c02-f47d-42ec-88d5-531722c10db2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:59.012203 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1cd62c02-f47d-42ec-88d5-531722c10db2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:59.019915 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1cd62c02-f47d-42ec-88d5-531722c10db2 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.149064 Jun 16 00:35:59.020479 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 487/950] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:58 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:59.482869 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-00dfa72b-8028-4ace-8297-27a8ddd9a5a0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:59.483472 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-00dfa72b-8028-4ace-8297-27a8ddd9a5a0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:59.489938 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-00dfa72b-8028-4ace-8297-27a8ddd9a5a0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:59.490383 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-00dfa72b-8028-4ace-8297-27a8ddd9a5a0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:59.491142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-00dfa72b-8028-4ace-8297-27a8ddd9a5a0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:59.491576 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-00dfa72b-8028-4ace-8297-27a8ddd9a5a0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:59.616351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-00dfa72b-8028-4ace-8297-27a8ddd9a5a0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:59.624030 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-00dfa72b-8028-4ace-8297-27a8ddd9a5a0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:59.625521 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-00dfa72b-8028-4ace-8297-27a8ddd9a5a0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:59.627168 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-00dfa72b-8028-4ace-8297-27a8ddd9a5a0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.147651 Jun 16 00:35:59.627745 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 464/951] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:59 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:00.036846 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4bd93db7-2bcd-4b5d-9f50-e7c37ce44ab9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:00.037452 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4bd93db7-2bcd-4b5d-9f50-e7c37ce44ab9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:00.043875 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4bd93db7-2bcd-4b5d-9f50-e7c37ce44ab9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:00.044318 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4bd93db7-2bcd-4b5d-9f50-e7c37ce44ab9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:00.045110 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4bd93db7-2bcd-4b5d-9f50-e7c37ce44ab9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:00.045540 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4bd93db7-2bcd-4b5d-9f50-e7c37ce44ab9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:00.175863 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4bd93db7-2bcd-4b5d-9f50-e7c37ce44ab9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:00.183151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4bd93db7-2bcd-4b5d-9f50-e7c37ce44ab9 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1566 microversion: 2.1 time: 0.150209 Jun 16 00:36:00.183921 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 488/952] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:00 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:00.646101 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6662fa17-fc86-4434-90bd-a9c32229789a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:00.646711 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6662fa17-fc86-4434-90bd-a9c32229789a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:00.653193 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6662fa17-fc86-4434-90bd-a9c32229789a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:00.653646 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6662fa17-fc86-4434-90bd-a9c32229789a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:00.654411 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6662fa17-fc86-4434-90bd-a9c32229789a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:00.654847 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6662fa17-fc86-4434-90bd-a9c32229789a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:00.782016 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6662fa17-fc86-4434-90bd-a9c32229789a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:00.790468 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6662fa17-fc86-4434-90bd-a9c32229789a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:00.791975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6662fa17-fc86-4434-90bd-a9c32229789a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:00.793131 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6662fa17-fc86-4434-90bd-a9c32229789a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.151906 Jun 16 00:36:00.793688 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 465/953] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:00 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:01.200759 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d498e9cd-95d3-47f8-bc80-de1481d77c94 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:01.209936 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d498e9cd-95d3-47f8-bc80-de1481d77c94 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:01.219570 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d498e9cd-95d3-47f8-bc80-de1481d77c94 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:01.220370 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d498e9cd-95d3-47f8-bc80-de1481d77c94 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:01.221169 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d498e9cd-95d3-47f8-bc80-de1481d77c94 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:01.222196 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d498e9cd-95d3-47f8-bc80-de1481d77c94 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:01.226680 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:01.421023 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d498e9cd-95d3-47f8-bc80-de1481d77c94 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:01.429482 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d498e9cd-95d3-47f8-bc80-de1481d77c94 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1447 microversion: 2.1 time: 0.232587 Jun 16 00:36:01.430367 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 489/954] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:01 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1447 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:01.514854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-62b404f4-6f91-4cba-a19b-915579ec3c26 req-5276846b-6fff-464f-8b6d-98d7df728484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb151dc-a559-4ad5-9a4f-c55e2609758f", "name": "network-vif-deleted", "tag": "bf8752fe-370d-4c67-8d58-5ab0ba31fdc9"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:01.528751 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-62b404f4-6f91-4cba-a19b-915579ec3c26 req-5276846b-6fff-464f-8b6d-98d7df728484 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:01.529199 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-62b404f4-6f91-4cba-a19b-915579ec3c26 req-5276846b-6fff-464f-8b6d-98d7df728484 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:01.541513 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-62b404f4-6f91-4cba-a19b-915579ec3c26 req-5276846b-6fff-464f-8b6d-98d7df728484 service nova] Creating event network-vif-deleted:bf8752fe-370d-4c67-8d58-5ab0ba31fdc9 for instance ebb151dc-a559-4ad5-9a4f-c55e2609758f on hv-cinder-84327 Jun 16 00:36:01.547107 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-62b404f4-6f91-4cba-a19b-915579ec3c26 req-5276846b-6fff-464f-8b6d-98d7df728484 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035976 Jun 16 00:36:01.548014 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 466/955] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:01.810329 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5a69b11b-b9c1-4885-abfb-30cc1fda2783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:01.810941 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5a69b11b-b9c1-4885-abfb-30cc1fda2783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:01.817348 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5a69b11b-b9c1-4885-abfb-30cc1fda2783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:01.817732 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5a69b11b-b9c1-4885-abfb-30cc1fda2783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:01.818515 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5a69b11b-b9c1-4885-abfb-30cc1fda2783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:01.818958 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5a69b11b-b9c1-4885-abfb-30cc1fda2783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:01.964883 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5a69b11b-b9c1-4885-abfb-30cc1fda2783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:01.974727 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5a69b11b-b9c1-4885-abfb-30cc1fda2783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:01.976254 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5a69b11b-b9c1-4885-abfb-30cc1fda2783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:01.977418 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5a69b11b-b9c1-4885-abfb-30cc1fda2783 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.171067 Jun 16 00:36:01.977968 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 490/956] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:01 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:02.446527 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-44b0136a-9322-4266-b0a5-77941afbb267 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:02.447298 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-44b0136a-9322-4266-b0a5-77941afbb267 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:02.453898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-44b0136a-9322-4266-b0a5-77941afbb267 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.454571 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-44b0136a-9322-4266-b0a5-77941afbb267 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.455719 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-44b0136a-9322-4266-b0a5-77941afbb267 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.456292 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-44b0136a-9322-4266-b0a5-77941afbb267 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.490609 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-44b0136a-9322-4266-b0a5-77941afbb267 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.491051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-44b0136a-9322-4266-b0a5-77941afbb267 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.491495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-44b0136a-9322-4266-b0a5-77941afbb267 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lazy-loading 'fault' on Instance uuid ebb151dc-a559-4ad5-9a4f-c55e2609758f {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:36:02.534430 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-44b0136a-9322-4266-b0a5-77941afbb267 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff74fa58ac342228f9f5235347bf6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c645f5673fe144de9432ba22b7d5ae87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:02.543470 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-44b0136a-9322-4266-b0a5-77941afbb267 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 200 len: 1222 microversion: 2.1 time: 0.100847 Jun 16 00:36:02.544305 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 467/957] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:02 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:02.996197 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a75b8aa8-e7ce-4a27-9fb6-d3cb39fc0bc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:02.996802 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a75b8aa8-e7ce-4a27-9fb6-d3cb39fc0bc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:03.003762 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a75b8aa8-e7ce-4a27-9fb6-d3cb39fc0bc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.004212 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a75b8aa8-e7ce-4a27-9fb6-d3cb39fc0bc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.004977 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a75b8aa8-e7ce-4a27-9fb6-d3cb39fc0bc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.005409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a75b8aa8-e7ce-4a27-9fb6-d3cb39fc0bc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.051722 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-ee9a33ee-3622-4ea1-aa30-2ad583c0b7b8 req-7fe6d38c-d1e5-46ad-af12-ac6eb38a519a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5a227f-6658-4f75-9193-65c781e2748f", "name": "network-vif-plugged", "status": "completed", "tag": "c16f9b3b-e924-4296-9815-07d0ab5a729b"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:03.060225 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-ee9a33ee-3622-4ea1-aa30-2ad583c0b7b8 req-7fe6d38c-d1e5-46ad-af12-ac6eb38a519a service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.060575 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-ee9a33ee-3622-4ea1-aa30-2ad583c0b7b8 req-7fe6d38c-d1e5-46ad-af12-ac6eb38a519a service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.074706 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-ee9a33ee-3622-4ea1-aa30-2ad583c0b7b8 req-7fe6d38c-d1e5-46ad-af12-ac6eb38a519a service nova] Creating event network-vif-plugged:c16f9b3b-e924-4296-9815-07d0ab5a729b for instance 3a5a227f-6658-4f75-9193-65c781e2748f on hv-cinder-84327 Jun 16 00:36:03.080147 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-ee9a33ee-3622-4ea1-aa30-2ad583c0b7b8 req-7fe6d38c-d1e5-46ad-af12-ac6eb38a519a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032503 Jun 16 00:36:03.080783 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 468/958] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:03.147262 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a75b8aa8-e7ce-4a27-9fb6-d3cb39fc0bc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:03.155855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a75b8aa8-e7ce-4a27-9fb6-d3cb39fc0bc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:03.157644 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a75b8aa8-e7ce-4a27-9fb6-d3cb39fc0bc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:03.159196 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a75b8aa8-e7ce-4a27-9fb6-d3cb39fc0bc2 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.166888 Jun 16 00:36:03.159773 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 491/959] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:02 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:03.562891 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-69258348-2086-4538-9dd2-8b4e0f5c93aa tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:03.563644 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-69258348-2086-4538-9dd2-8b4e0f5c93aa tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] [instance: ebb151dc-a559-4ad5-9a4f-c55e2609758f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:03.569838 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-69258348-2086-4538-9dd2-8b4e0f5c93aa tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.570291 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-69258348-2086-4538-9dd2-8b4e0f5c93aa tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.571056 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-69258348-2086-4538-9dd2-8b4e0f5c93aa tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.571495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-69258348-2086-4538-9dd2-8b4e0f5c93aa tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.585066 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-69258348-2086-4538-9dd2-8b4e0f5c93aa tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] HTTP exception thrown: Instance ebb151dc-a559-4ad5-9a4f-c55e2609758f could not be found. Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-69258348-2086-4538-9dd2-8b4e0f5c93aa tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Request method failure captured: Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f HTTP/1.1 Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnmGofCKmIhL23dmQUoIDpKwki3NqyW3BLgpVsag2svZRRFi8AiwjFwsAK2qgiGLYBBXOIuuTeRIYTME1Fvv9QV4L7j5RELwlwO9GxL19aHUls3-uug5II23YnlJSIQXq-zHb8JVeTvVzCH-yTBNPmHinLJw5kRfSuuV39OZviftr6I Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: c645f5673fe144de9432ba22b7d5ae87 Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-TestShelveInstance-1012828128 Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:36:03.586601 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:36:03.588238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c645f5673fe144de9432ba22b7d5ae87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c645f5673fe144de9432ba22b7d5ae87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c645f5673fe144de9432ba22b7d5ae87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c645f5673fe144de9432ba22b7d5ae87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:36:03.588238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-TestShelveInstance-1012828128 Jun 16 00:36:03.588238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: c645f5673fe144de9432ba22b7d5ae87 Jun 16 00:36:03.588238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-TestShelveInstance-1012828128 Jun 16 00:36:03.588238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-TestShelveInstance-1012828128-project Jun 16 00:36:03.588238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:36:03.588238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:36:03.588238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: cff74fa58ac342228f9f5235347bf6bb Jun 16 00:36:03.588238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-TestShelveInstance-1012828128-project Jun 16 00:36:03.588238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:36:03.588238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance ebb151dc-a559-4ad5-9a4f-c55e2609758f could not be found. Jun 16 00:36:03.588238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': 'ebb151dc-a559-4ad5-9a4f-c55e2609758f'} Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebb151dc-a559-4ad5-9a4f-c55e2609758f could not be found. Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:03.589379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebb151dc-a559-4ad5-9a4f-c55e2609758f could not be found. Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebb151dc-a559-4ad5-9a4f-c55e2609758f could not be found. Jun 16 00:36:03.591010 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.592612 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-69258348-2086-4538-9dd2-8b4e0f5c93aa tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Returning 404 to user: Instance ebb151dc-a559-4ad5-9a4f-c55e2609758f could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:03.592612 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-69258348-2086-4538-9dd2-8b4e0f5c93aa tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f" status: 404 len: 111 microversion: 2.1 time: 0.029833 Jun 16 00:36:03.592612 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 469/960] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:03 2022] GET /compute/v2.1/servers/ebb151dc-a559-4ad5-9a4f-c55e2609758f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:03.752151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ef6b207c-3e56-45e1-9397-aa27e4def786 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] Calling method '.version_select at 0x7f9573d49a60>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:03.771727 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ef6b207c-3e56-45e1-9397-aa27e4def786 tempest-TestShelveInstance-1012828128 tempest-TestShelveInstance-1012828128-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-46501161" status: 202 len: 0 microversion: 2.1 time: 0.023447 Jun 16 00:36:03.772341 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 492/961] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 16 00:36:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-46501161 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:36:04.177422 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6ae5b0cc-6e48-4320-b012-7fc2602b8591 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:04.177967 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6ae5b0cc-6e48-4320-b012-7fc2602b8591 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:04.183995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6ae5b0cc-6e48-4320-b012-7fc2602b8591 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:04.184448 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6ae5b0cc-6e48-4320-b012-7fc2602b8591 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:04.185224 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6ae5b0cc-6e48-4320-b012-7fc2602b8591 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:04.185666 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6ae5b0cc-6e48-4320-b012-7fc2602b8591 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:04.393835 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6ae5b0cc-6e48-4320-b012-7fc2602b8591 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:04.401646 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6ae5b0cc-6e48-4320-b012-7fc2602b8591 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:04.403142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6ae5b0cc-6e48-4320-b012-7fc2602b8591 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:04.404330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6ae5b0cc-6e48-4320-b012-7fc2602b8591 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.230927 Jun 16 00:36:04.404881 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 470/962] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:04 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:05.424161 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-de0da0f9-9ade-4fe6-b96a-1092b4e170bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:05.424775 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-de0da0f9-9ade-4fe6-b96a-1092b4e170bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:05.430688 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-de0da0f9-9ade-4fe6-b96a-1092b4e170bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:05.431130 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-de0da0f9-9ade-4fe6-b96a-1092b4e170bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:05.432010 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-de0da0f9-9ade-4fe6-b96a-1092b4e170bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:05.432440 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-de0da0f9-9ade-4fe6-b96a-1092b4e170bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:05.717885 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-de0da0f9-9ade-4fe6-b96a-1092b4e170bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:05.726656 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-de0da0f9-9ade-4fe6-b96a-1092b4e170bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:05.729212 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-de0da0f9-9ade-4fe6-b96a-1092b4e170bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:05.731823 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-de0da0f9-9ade-4fe6-b96a-1092b4e170bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1730 microversion: 2.20 time: 0.312773 Jun 16 00:36:05.737660 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 493/963] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:05 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1730 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:06.757666 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ecf4f889-70e4-4460-bd66-2988494d482a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:06.758414 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ecf4f889-70e4-4460-bd66-2988494d482a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:06.766234 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ecf4f889-70e4-4460-bd66-2988494d482a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:06.766992 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ecf4f889-70e4-4460-bd66-2988494d482a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:06.768899 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ecf4f889-70e4-4460-bd66-2988494d482a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:06.769540 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ecf4f889-70e4-4460-bd66-2988494d482a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:06.997988 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ecf4f889-70e4-4460-bd66-2988494d482a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:07.006624 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ecf4f889-70e4-4460-bd66-2988494d482a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:07.009101 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ecf4f889-70e4-4460-bd66-2988494d482a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:07.010872 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ecf4f889-70e4-4460-bd66-2988494d482a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1717 microversion: 2.20 time: 0.258458 Jun 16 00:36:07.012153 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 471/964] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:06 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1717 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:07.948920 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-418cca91-c538-4f2c-8c23-ce957e7741f7 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:07.957888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-418cca91-c538-4f2c-8c23-ce957e7741f7 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:07.958598 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-418cca91-c538-4f2c-8c23-ce957e7741f7 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:08.022682 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-418cca91-c538-4f2c-8c23-ce957e7741f7 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Going to try to stop instance {{(pid=129466) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 00:36:08.068547 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-418cca91-c538-4f2c-8c23-ce957e7741f7 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "POST /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/action" status: 202 len: 0 microversion: 2.1 time: 0.124362 Jun 16 00:36:08.069320 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 494/965] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:36:07 2022] POST /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:36:08.077813 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-acd28287-1772-4f51-acad-749fffc0d460 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:08.079180 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-acd28287-1772-4f51-acad-749fffc0d460 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:08.088239 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-acd28287-1772-4f51-acad-749fffc0d460 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:08.088958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-acd28287-1772-4f51-acad-749fffc0d460 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:08.090021 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-acd28287-1772-4f51-acad-749fffc0d460 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:08.090723 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-acd28287-1772-4f51-acad-749fffc0d460 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:08.301017 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-acd28287-1772-4f51-acad-749fffc0d460 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:08.309396 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-acd28287-1772-4f51-acad-749fffc0d460 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1722 microversion: 2.1 time: 0.235789 Jun 16 00:36:08.310045 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 472/966] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:08 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:09.326821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a451e6b2-624a-415b-954d-2947c0ad9732 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:09.327534 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a451e6b2-624a-415b-954d-2947c0ad9732 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:09.335148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a451e6b2-624a-415b-954d-2947c0ad9732 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:09.335594 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a451e6b2-624a-415b-954d-2947c0ad9732 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:09.336488 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a451e6b2-624a-415b-954d-2947c0ad9732 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:09.336838 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a451e6b2-624a-415b-954d-2947c0ad9732 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:09.601617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a451e6b2-624a-415b-954d-2947c0ad9732 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:09.610111 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a451e6b2-624a-415b-954d-2947c0ad9732 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1722 microversion: 2.1 time: 0.287539 Jun 16 00:36:09.610670 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 495/967] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:09 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:10.627478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-39663925-0fdd-42e1-91c5-50c1a5e338d0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:10.628116 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-39663925-0fdd-42e1-91c5-50c1a5e338d0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:10.634579 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-39663925-0fdd-42e1-91c5-50c1a5e338d0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:10.635025 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-39663925-0fdd-42e1-91c5-50c1a5e338d0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:10.635810 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-39663925-0fdd-42e1-91c5-50c1a5e338d0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:10.636245 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-39663925-0fdd-42e1-91c5-50c1a5e338d0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:11.017198 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-39663925-0fdd-42e1-91c5-50c1a5e338d0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:11.026281 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-39663925-0fdd-42e1-91c5-50c1a5e338d0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1722 microversion: 2.1 time: 0.402547 Jun 16 00:36:11.026912 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 473/968] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:10 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1722 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:12.043598 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-55700fea-1a30-4793-98c9-57cf18ba87cc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:12.044249 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-55700fea-1a30-4793-98c9-57cf18ba87cc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:12.051343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-55700fea-1a30-4793-98c9-57cf18ba87cc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:12.051823 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-55700fea-1a30-4793-98c9-57cf18ba87cc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:12.052770 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-55700fea-1a30-4793-98c9-57cf18ba87cc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:12.053204 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-55700fea-1a30-4793-98c9-57cf18ba87cc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:12.177839 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-55700fea-1a30-4793-98c9-57cf18ba87cc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:12.185639 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-55700fea-1a30-4793-98c9-57cf18ba87cc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1722 microversion: 2.1 time: 0.145864 Jun 16 00:36:12.186190 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 496/969] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:12 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:13.203944 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a6d7c9d6-7c1e-4c4d-8e03-abac38f2cc83 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:13.204573 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a6d7c9d6-7c1e-4c4d-8e03-abac38f2cc83 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:13.211937 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a6d7c9d6-7c1e-4c4d-8e03-abac38f2cc83 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:13.212391 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a6d7c9d6-7c1e-4c4d-8e03-abac38f2cc83 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:13.213154 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a6d7c9d6-7c1e-4c4d-8e03-abac38f2cc83 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:13.213594 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a6d7c9d6-7c1e-4c4d-8e03-abac38f2cc83 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:13.341868 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a6d7c9d6-7c1e-4c4d-8e03-abac38f2cc83 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:13.349887 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a6d7c9d6-7c1e-4c4d-8e03-abac38f2cc83 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1722 microversion: 2.1 time: 0.149842 Jun 16 00:36:13.350449 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 474/970] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:13 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:14.367908 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d2c8a293-65d1-4fec-8585-df0c9bea767b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:14.368542 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d2c8a293-65d1-4fec-8585-df0c9bea767b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:14.374712 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d2c8a293-65d1-4fec-8585-df0c9bea767b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:14.375158 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d2c8a293-65d1-4fec-8585-df0c9bea767b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:14.375929 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d2c8a293-65d1-4fec-8585-df0c9bea767b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:14.376362 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d2c8a293-65d1-4fec-8585-df0c9bea767b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:14.501428 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d2c8a293-65d1-4fec-8585-df0c9bea767b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:14.509337 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d2c8a293-65d1-4fec-8585-df0c9bea767b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1722 microversion: 2.1 time: 0.145311 Jun 16 00:36:14.509891 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 497/971] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:14 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:15.526501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7199b99a-d6ac-4a6c-b9b4-346fc24d45dd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:15.527112 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7199b99a-d6ac-4a6c-b9b4-346fc24d45dd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:15.533656 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7199b99a-d6ac-4a6c-b9b4-346fc24d45dd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:15.534104 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7199b99a-d6ac-4a6c-b9b4-346fc24d45dd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:15.534868 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7199b99a-d6ac-4a6c-b9b4-346fc24d45dd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:15.535304 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7199b99a-d6ac-4a6c-b9b4-346fc24d45dd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:15.662189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7199b99a-d6ac-4a6c-b9b4-346fc24d45dd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:15.670141 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7199b99a-d6ac-4a6c-b9b4-346fc24d45dd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1722 microversion: 2.1 time: 0.147571 Jun 16 00:36:15.670708 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 475/972] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:15 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:16.688166 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a98c4654-14d4-4946-b0c2-e74a21c2c4e1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:16.689113 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a98c4654-14d4-4946-b0c2-e74a21c2c4e1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:16.696968 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a98c4654-14d4-4946-b0c2-e74a21c2c4e1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:16.697413 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a98c4654-14d4-4946-b0c2-e74a21c2c4e1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:16.698173 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a98c4654-14d4-4946-b0c2-e74a21c2c4e1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:16.698602 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a98c4654-14d4-4946-b0c2-e74a21c2c4e1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:16.826498 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a98c4654-14d4-4946-b0c2-e74a21c2c4e1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:16.835016 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a98c4654-14d4-4946-b0c2-e74a21c2c4e1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1722 microversion: 2.1 time: 0.151314 Jun 16 00:36:16.835579 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 498/973] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:16 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:17.851471 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-40765cb5-265a-49db-9eef-c3d77773ba74 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:17.852122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-40765cb5-265a-49db-9eef-c3d77773ba74 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:17.858694 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-40765cb5-265a-49db-9eef-c3d77773ba74 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:17.859147 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-40765cb5-265a-49db-9eef-c3d77773ba74 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:17.859955 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-40765cb5-265a-49db-9eef-c3d77773ba74 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:17.860399 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-40765cb5-265a-49db-9eef-c3d77773ba74 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:17.992638 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-40765cb5-265a-49db-9eef-c3d77773ba74 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:18.000604 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-40765cb5-265a-49db-9eef-c3d77773ba74 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1722 microversion: 2.1 time: 0.152987 Jun 16 00:36:18.001168 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 476/974] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:17 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:19.019060 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d1022581-f0b7-4eb8-aab6-898106d405ed tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:19.019697 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d1022581-f0b7-4eb8-aab6-898106d405ed tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:19.026148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d1022581-f0b7-4eb8-aab6-898106d405ed tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:19.026597 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d1022581-f0b7-4eb8-aab6-898106d405ed tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:19.027359 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d1022581-f0b7-4eb8-aab6-898106d405ed tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:19.027829 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d1022581-f0b7-4eb8-aab6-898106d405ed tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:19.151667 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d1022581-f0b7-4eb8-aab6-898106d405ed tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:19.159558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d1022581-f0b7-4eb8-aab6-898106d405ed tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1699 microversion: 2.1 time: 0.144964 Jun 16 00:36:19.160147 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 499/975] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:19 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1699 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:19.175792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f8eb9ca7-453f-43f0-b8b3-d8e93204b648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:19.182296 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f8eb9ca7-453f-43f0-b8b3-d8e93204b648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:19.182749 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f8eb9ca7-453f-43f0-b8b3-d8e93204b648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:19.241301 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f8eb9ca7-453f-43f0-b8b3-d8e93204b648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Going to try to start instance {{(pid=129465) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 00:36:19.282754 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f8eb9ca7-453f-43f0-b8b3-d8e93204b648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "POST /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/action" status: 202 len: 0 microversion: 2.1 time: 0.110652 Jun 16 00:36:19.283362 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 477/976] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:36:19 2022] POST /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:36:19.291573 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-61257fe0-0981-4b79-84c1-b611f2f00648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:19.292202 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-61257fe0-0981-4b79-84c1-b611f2f00648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:19.298222 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-61257fe0-0981-4b79-84c1-b611f2f00648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:19.298673 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-61257fe0-0981-4b79-84c1-b611f2f00648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:19.299991 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-61257fe0-0981-4b79-84c1-b611f2f00648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:19.300427 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-61257fe0-0981-4b79-84c1-b611f2f00648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:19.437501 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-61257fe0-0981-4b79-84c1-b611f2f00648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:19.446211 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-61257fe0-0981-4b79-84c1-b611f2f00648 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1708 microversion: 2.1 time: 0.158600 Jun 16 00:36:19.446995 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 500/977] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:19 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:20.464020 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d339f5a2-daa0-43f9-a1ee-27ff1e087ba8 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:20.464723 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d339f5a2-daa0-43f9-a1ee-27ff1e087ba8 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:20.470835 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d339f5a2-daa0-43f9-a1ee-27ff1e087ba8 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:20.471286 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d339f5a2-daa0-43f9-a1ee-27ff1e087ba8 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:20.472119 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d339f5a2-daa0-43f9-a1ee-27ff1e087ba8 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:20.472554 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d339f5a2-daa0-43f9-a1ee-27ff1e087ba8 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:20.605074 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-d339f5a2-daa0-43f9-a1ee-27ff1e087ba8 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:20.613083 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d339f5a2-daa0-43f9-a1ee-27ff1e087ba8 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1708 microversion: 2.1 time: 0.153814 Jun 16 00:36:20.613650 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 478/978] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:20 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:21.630195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3f3776fa-0a04-4758-a4cc-22bcf1c571dc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:21.630800 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-3f3776fa-0a04-4758-a4cc-22bcf1c571dc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:21.637198 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3f3776fa-0a04-4758-a4cc-22bcf1c571dc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:21.637666 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3f3776fa-0a04-4758-a4cc-22bcf1c571dc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:21.638422 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3f3776fa-0a04-4758-a4cc-22bcf1c571dc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:21.638854 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3f3776fa-0a04-4758-a4cc-22bcf1c571dc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:21.763844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3f3776fa-0a04-4758-a4cc-22bcf1c571dc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:21.772590 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3f3776fa-0a04-4758-a4cc-22bcf1c571dc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1712 microversion: 2.1 time: 0.146163 Jun 16 00:36:21.773179 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 501/979] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:21 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1712 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:25.399241 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:36:25.399884 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Thu Jun 16 00:36:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:36:41.807902 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3858410b-393e-4863-b9e8-76b74e36289b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:41.808417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3858410b-393e-4863-b9e8-76b74e36289b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:41.810586 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=39 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:41.811231 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:41.817189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3858410b-393e-4863-b9e8-76b74e36289b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:41.817628 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3858410b-393e-4863-b9e8-76b74e36289b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:41.818383 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3858410b-393e-4863-b9e8-76b74e36289b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:41.818811 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3858410b-393e-4863-b9e8-76b74e36289b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:41.842850 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3858410b-393e-4863-b9e8-76b74e36289b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774/ips" status: 200 len: 148 microversion: 2.1 time: 0.039041 Jun 16 00:36:41.843391 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 479/980] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 16 00:36:41 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:41.968243 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:36:41.968446 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Thu Jun 16 00:36:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:36:43.150276 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8c3ce86b-4c67-43c9-bf34-49f0bb9ad6da tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82a28161-ade2-4385-b491-a6a3335eb0c7"}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:43.151425 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8c3ce86b-4c67-43c9-bf34-49f0bb9ad6da tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:43.153656 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:43.154439 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:43.161795 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c3ce86b-4c67-43c9-bf34-49f0bb9ad6da tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:43.162247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c3ce86b-4c67-43c9-bf34-49f0bb9ad6da tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:43.163014 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c3ce86b-4c67-43c9-bf34-49f0bb9ad6da tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:43.163449 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8c3ce86b-4c67-43c9-bf34-49f0bb9ad6da tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:43.418104 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8c3ce86b-4c67-43c9-bf34-49f0bb9ad6da tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "POST /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272401 Jun 16 00:36:43.419031 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 502/981] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:36:43 2022] POST /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:50.988640 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a21a6ca0-4cca-47f6-84da-2ad619c174b1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:50.989135 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a21a6ca0-4cca-47f6-84da-2ad619c174b1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:50.996040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a21a6ca0-4cca-47f6-84da-2ad619c174b1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:50.996482 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a21a6ca0-4cca-47f6-84da-2ad619c174b1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:50.997233 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a21a6ca0-4cca-47f6-84da-2ad619c174b1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:50.997663 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a21a6ca0-4cca-47f6-84da-2ad619c174b1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:51.077545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-a21a6ca0-4cca-47f6-84da-2ad619c174b1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lazy-loading 'services' on Instance uuid a0ebcc60-4082-48e9-8efa-dd22c7e01774 {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:36:51.149872 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a21a6ca0-4cca-47f6-84da-2ad619c174b1 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774/os-volume_attachments/82a28161-ade2-4385-b491-a6a3335eb0c7" status: 202 len: 0 microversion: 2.1 time: 0.165464 Jun 16 00:36:51.150436 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 480/982] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 16 00:36:50 2022] DELETE /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774/os-volume_attachments/82a28161-ade2-4385-b491-a6a3335eb0c7 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:36:51.160252 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7d219032-f100-419a-a992-838b3de8e159 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:51.161249 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7d219032-f100-419a-a992-838b3de8e159 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:51.167682 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7d219032-f100-419a-a992-838b3de8e159 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:51.168217 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7d219032-f100-419a-a992-838b3de8e159 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:51.168988 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7d219032-f100-419a-a992-838b3de8e159 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:51.169575 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7d219032-f100-419a-a992-838b3de8e159 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:51.199945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7d219032-f100-419a-a992-838b3de8e159 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 Jun 16 00:36:51.200498 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 503/983] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:36:51 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:52.212731 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e8119a19-cfb6-4e9b-abb0-11307f88946e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:52.213777 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e8119a19-cfb6-4e9b-abb0-11307f88946e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:52.220345 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e8119a19-cfb6-4e9b-abb0-11307f88946e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:52.221288 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e8119a19-cfb6-4e9b-abb0-11307f88946e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:52.222062 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e8119a19-cfb6-4e9b-abb0-11307f88946e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:52.222496 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e8119a19-cfb6-4e9b-abb0-11307f88946e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:52.250555 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e8119a19-cfb6-4e9b-abb0-11307f88946e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042785 Jun 16 00:36:52.251090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 481/984] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:36:52 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:36:52.307363 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4ebc6c98-44c7-4e21-83f6-9a5571dc3da6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:52.307883 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4ebc6c98-44c7-4e21-83f6-9a5571dc3da6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:52.314319 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4ebc6c98-44c7-4e21-83f6-9a5571dc3da6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:52.314771 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4ebc6c98-44c7-4e21-83f6-9a5571dc3da6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:52.315536 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4ebc6c98-44c7-4e21-83f6-9a5571dc3da6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:52.315993 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4ebc6c98-44c7-4e21-83f6-9a5571dc3da6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:52.341111 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4ebc6c98-44c7-4e21-83f6-9a5571dc3da6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Going to try to terminate instance {{(pid=129466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:36:52.414871 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4ebc6c98-44c7-4e21-83f6-9a5571dc3da6 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 204 len: 0 microversion: 2.1 time: 0.110869 Jun 16 00:36:52.415601 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 504/985] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:36:52 2022] DELETE /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:36:52.424644 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c3f46993-ed56-4d11-bacc-27866493a84b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:52.425298 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c3f46993-ed56-4d11-bacc-27866493a84b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:52.431205 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c3f46993-ed56-4d11-bacc-27866493a84b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:52.431689 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c3f46993-ed56-4d11-bacc-27866493a84b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:52.432458 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c3f46993-ed56-4d11-bacc-27866493a84b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:52.432891 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c3f46993-ed56-4d11-bacc-27866493a84b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:52.563582 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c3f46993-ed56-4d11-bacc-27866493a84b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:52.571134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c3f46993-ed56-4d11-bacc-27866493a84b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1678 microversion: 2.1 time: 0.150938 Jun 16 00:36:52.571735 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 482/986] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:52 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:53.589565 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cbea8e1a-9904-4a81-9ce3-a2afc122fdac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:53.590260 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-cbea8e1a-9904-4a81-9ce3-a2afc122fdac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:53.597336 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cbea8e1a-9904-4a81-9ce3-a2afc122fdac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:53.597811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cbea8e1a-9904-4a81-9ce3-a2afc122fdac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:53.598574 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cbea8e1a-9904-4a81-9ce3-a2afc122fdac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:53.599006 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cbea8e1a-9904-4a81-9ce3-a2afc122fdac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:53.726624 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-cbea8e1a-9904-4a81-9ce3-a2afc122fdac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:53.734003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-cbea8e1a-9904-4a81-9ce3-a2afc122fdac tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1678 microversion: 2.1 time: 0.148714 Jun 16 00:36:53.734566 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 505/987] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:53 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:54.751597 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2a3d2fe9-01d4-4fd2-86c0-a04b7dcf53b0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:54.752238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2a3d2fe9-01d4-4fd2-86c0-a04b7dcf53b0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:54.758624 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2a3d2fe9-01d4-4fd2-86c0-a04b7dcf53b0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:54.759086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2a3d2fe9-01d4-4fd2-86c0-a04b7dcf53b0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:54.759887 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2a3d2fe9-01d4-4fd2-86c0-a04b7dcf53b0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:54.760335 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2a3d2fe9-01d4-4fd2-86c0-a04b7dcf53b0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:54.975800 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2a3d2fe9-01d4-4fd2-86c0-a04b7dcf53b0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c5a5705f34440abce48190674a76d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'def39ced63b64e3aa65c9542ae512e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:54.983233 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2a3d2fe9-01d4-4fd2-86c0-a04b7dcf53b0 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 200 len: 1678 microversion: 2.1 time: 0.235610 Jun 16 00:36:54.983826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 483/988] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:54 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:55.347420 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-5cad3ef2-33eb-46c8-a49a-65a446059ba9 req-75d82ab3-9042-4dbd-908c-9a1cee025338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ebcc60-4082-48e9-8efa-dd22c7e01774", "name": "network-vif-deleted", "tag": "e22ec279-19d4-4801-949d-a1ac3d959175"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:55.356047 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-5cad3ef2-33eb-46c8-a49a-65a446059ba9 req-75d82ab3-9042-4dbd-908c-9a1cee025338 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:55.356557 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-5cad3ef2-33eb-46c8-a49a-65a446059ba9 req-75d82ab3-9042-4dbd-908c-9a1cee025338 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:55.369231 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-5cad3ef2-33eb-46c8-a49a-65a446059ba9 req-75d82ab3-9042-4dbd-908c-9a1cee025338 service nova] Creating event network-vif-deleted:e22ec279-19d4-4801-949d-a1ac3d959175 for instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 on hv-cinder-84327 Jun 16 00:36:55.375125 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-5cad3ef2-33eb-46c8-a49a-65a446059ba9 req-75d82ab3-9042-4dbd-908c-9a1cee025338 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031273 Jun 16 00:36:55.376001 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 506/989] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:56.000200 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c69c5c26-c507-4462-b91e-c0f447515bd5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:56.000936 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c69c5c26-c507-4462-b91e-c0f447515bd5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:56.008238 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c69c5c26-c507-4462-b91e-c0f447515bd5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:56.008790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c69c5c26-c507-4462-b91e-c0f447515bd5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:56.009645 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c69c5c26-c507-4462-b91e-c0f447515bd5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:56.010160 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c69c5c26-c507-4462-b91e-c0f447515bd5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:56.023867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-c69c5c26-c507-4462-b91e-c0f447515bd5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c69c5c26-c507-4462-b91e-c0f447515bd5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 HTTP/1.1 Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:36:56.025534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:36:56.027108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:36:56.027108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:56.027108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:56.027108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:56.027108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:56.027108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:36:56.027108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:36:56.027108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:36:56.027108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:56.027108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:36:56.027108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:56.027108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': 'a0ebcc60-4082-48e9-8efa-dd22c7e01774'} Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:56.028176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:56.029485 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:56.030672 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c69c5c26-c507-4462-b91e-c0f447515bd5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 404 to user: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:56.030672 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c69c5c26-c507-4462-b91e-c0f447515bd5 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 404 len: 111 microversion: 2.1 time: 0.030634 Jun 16 00:36:56.030672 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 484/990] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:55 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:56.036358 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-479bd9dd-443b-42a4-b375-cfa1c424fa2b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '.version_select at 0x7f9573db6040>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:56.054663 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-479bd9dd-443b-42a4-b375-cfa1c424fa2b tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-407689939" status: 202 len: 0 microversion: 2.1 time: 0.022341 Jun 16 00:36:56.055159 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 507/991] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jun 16 00:36:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-407689939 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:36:57.787197 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c10f6f76-a5b6-47b4-a530-3feacc347ee3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:57.787795 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c10f6f76-a5b6-47b4-a530-3feacc347ee3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:57.794370 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c10f6f76-a5b6-47b4-a530-3feacc347ee3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:57.794854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c10f6f76-a5b6-47b4-a530-3feacc347ee3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:57.795632 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c10f6f76-a5b6-47b4-a530-3feacc347ee3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:57.796075 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c10f6f76-a5b6-47b4-a530-3feacc347ee3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:57.809379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-c10f6f76-a5b6-47b4-a530-3feacc347ee3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c10f6f76-a5b6-47b4-a530-3feacc347ee3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: DELETE /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 HTTP/1.1 Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:36:57.810894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:36:57.812517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:36:57.812517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:57.812517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:57.812517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:57.812517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:57.812517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:36:57.812517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:36:57.812517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:36:57.812517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:57.812517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:36:57.812517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:57.812517 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': 'a0ebcc60-4082-48e9-8efa-dd22c7e01774'} Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:57.813412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:57.814897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:57.816393 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c10f6f76-a5b6-47b4-a530-3feacc347ee3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 404 to user: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:57.816393 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c10f6f76-a5b6-47b4-a530-3feacc347ee3 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 404 len: 111 microversion: 2.1 time: 0.029546 Jun 16 00:36:57.816393 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 485/992] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:36:57 2022] DELETE /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:57.821425 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1dc34cf9-b188-4545-a662-f6488754fc02 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:57.822151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1dc34cf9-b188-4545-a662-f6488754fc02 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a0ebcc60-4082-48e9-8efa-dd22c7e01774] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:57.828254 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1dc34cf9-b188-4545-a662-f6488754fc02 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:57.828695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1dc34cf9-b188-4545-a662-f6488754fc02 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:57.829453 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1dc34cf9-b188-4545-a662-f6488754fc02 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:57.829885 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1dc34cf9-b188-4545-a662-f6488754fc02 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:57.843168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-1dc34cf9-b188-4545-a662-f6488754fc02 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1dc34cf9-b188-4545-a662-f6488754fc02 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 HTTP/1.1 Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:36:57.844766 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:36:57.846900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:36:57.846900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:57.846900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:57.846900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:57.846900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:57.846900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:36:57.846900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:36:57.846900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:36:57.846900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:57.846900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:36:57.846900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:57.846900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': 'a0ebcc60-4082-48e9-8efa-dd22c7e01774'} Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:57.847811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. Jun 16 00:36:57.849287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:57.850665 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1dc34cf9-b188-4545-a662-f6488754fc02 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 404 to user: Instance a0ebcc60-4082-48e9-8efa-dd22c7e01774 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:57.850665 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1dc34cf9-b188-4545-a662-f6488754fc02 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774" status: 404 len: 111 microversion: 2.1 time: 0.029100 Jun 16 00:36:57.850665 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 508/993] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:57 2022] GET /compute/v2.1/servers/a0ebcc60-4082-48e9-8efa-dd22c7e01774 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:58.978549 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a294c367-730a-467e-995e-4b293235694e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:58.979032 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a294c367-730a-467e-995e-4b293235694e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:58.985617 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a294c367-730a-467e-995e-4b293235694e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:58.986090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a294c367-730a-467e-995e-4b293235694e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:58.987547 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a294c367-730a-467e-995e-4b293235694e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:58.988019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a294c367-730a-467e-995e-4b293235694e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.002995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-a294c367-730a-467e-995e-4b293235694e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a294c367-730a-467e-995e-4b293235694e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: DELETE /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c HTTP/1.1 Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:36:59.004523 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:36:59.006096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:36:59.006096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:59.006096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:59.006096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:59.006096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:59.006096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:36:59.006096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:36:59.006096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:36:59.006096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:59.006096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:36:59.006096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:36:59.006096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': 'a897b2e2-7e05-4ed8-8252-ddaad24dff1c'} Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:59.007790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:36:59.009246 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.010684 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a294c367-730a-467e-995e-4b293235694e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 404 to user: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:59.010684 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a294c367-730a-467e-995e-4b293235694e tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 404 len: 111 microversion: 2.1 time: 0.031265 Jun 16 00:36:59.010684 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 486/994] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:36:58 2022] DELETE /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:59.014301 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-157b685c-4d34-4e71-abb9-7f300bed8b83 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:59.014915 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-157b685c-4d34-4e71-abb9-7f300bed8b83 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: a897b2e2-7e05-4ed8-8252-ddaad24dff1c] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:59.022138 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-157b685c-4d34-4e71-abb9-7f300bed8b83 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.022581 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-157b685c-4d34-4e71-abb9-7f300bed8b83 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.023340 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-157b685c-4d34-4e71-abb9-7f300bed8b83 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.023801 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-157b685c-4d34-4e71-abb9-7f300bed8b83 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.039318 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-157b685c-4d34-4e71-abb9-7f300bed8b83 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-157b685c-4d34-4e71-abb9-7f300bed8b83 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c HTTP/1.1 Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:36:59.040858 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:36:59.042392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:36:59.042392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:59.042392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:59.042392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:59.042392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:59.042392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:36:59.042392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:36:59.042392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:36:59.042392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:59.042392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:36:59.042392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:36:59.042392 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': 'a897b2e2-7e05-4ed8-8252-ddaad24dff1c'} Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:59.043186 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. Jun 16 00:36:59.044409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.045457 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-157b685c-4d34-4e71-abb9-7f300bed8b83 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 404 to user: Instance a897b2e2-7e05-4ed8-8252-ddaad24dff1c could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:59.045457 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-157b685c-4d34-4e71-abb9-7f300bed8b83 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c" status: 404 len: 111 microversion: 2.1 time: 0.031767 Jun 16 00:36:59.045457 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 509/995] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:59 2022] GET /compute/v2.1/servers/a897b2e2-7e05-4ed8-8252-ddaad24dff1c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:36:59.050495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4695ed9f-b67e-4176-994e-24d0797fe176 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:59.050984 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4695ed9f-b67e-4176-994e-24d0797fe176 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:59.057135 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4695ed9f-b67e-4176-994e-24d0797fe176 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.057520 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4695ed9f-b67e-4176-994e-24d0797fe176 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.058268 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4695ed9f-b67e-4176-994e-24d0797fe176 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.058695 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4695ed9f-b67e-4176-994e-24d0797fe176 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.071704 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-4695ed9f-b67e-4176-994e-24d0797fe176 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4695ed9f-b67e-4176-994e-24d0797fe176 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: DELETE /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 HTTP/1.1 Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:36:59.073206 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:36:59.074830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:36:59.074830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:59.074830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:59.074830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:59.074830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:59.074830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:36:59.074830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:36:59.074830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:36:59.074830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:59.074830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:36:59.074830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:36:59.074830 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '15d275db-db63-4899-b5f6-ed3852580687'} Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:59.075781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:36:59.077306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.078643 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4695ed9f-b67e-4176-994e-24d0797fe176 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 404 to user: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:59.078643 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4695ed9f-b67e-4176-994e-24d0797fe176 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 404 len: 111 microversion: 2.1 time: 0.027828 Jun 16 00:36:59.078643 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 487/996] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:36:59 2022] DELETE /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:59.083231 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-80b5c5e7-ee8c-410c-9f56-942ea46fe260 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:59.083857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-80b5c5e7-ee8c-410c-9f56-942ea46fe260 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 15d275db-db63-4899-b5f6-ed3852580687] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:59.089729 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-80b5c5e7-ee8c-410c-9f56-942ea46fe260 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.090180 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-80b5c5e7-ee8c-410c-9f56-942ea46fe260 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.090936 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-80b5c5e7-ee8c-410c-9f56-942ea46fe260 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.091370 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-80b5c5e7-ee8c-410c-9f56-942ea46fe260 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.104881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-80b5c5e7-ee8c-410c-9f56-942ea46fe260 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-80b5c5e7-ee8c-410c-9f56-942ea46fe260 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 HTTP/1.1 Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:36:59.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:36:59.108235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:36:59.108235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:59.108235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:36:59.108235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:36:59.108235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:59.108235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:36:59.108235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:36:59.108235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:36:59.108235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:36:59.108235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:36:59.108235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:36:59.108235 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '15d275db-db63-4899-b5f6-ed3852580687'} Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:59.109151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. Jun 16 00:36:59.110610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:36:59.112307 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-80b5c5e7-ee8c-410c-9f56-942ea46fe260 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 404 to user: Instance 15d275db-db63-4899-b5f6-ed3852580687 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:59.112307 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-80b5c5e7-ee8c-410c-9f56-942ea46fe260 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687" status: 404 len: 111 microversion: 2.1 time: 0.028767 Jun 16 00:36:59.112307 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 510/997] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:59 2022] GET /compute/v2.1/servers/15d275db-db63-4899-b5f6-ed3852580687 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:00.239011 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d5bf7a38-c18c-4aa3-b43d-3d3cea735964 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:00.239499 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d5bf7a38-c18c-4aa3-b43d-3d3cea735964 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:00.245896 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d5bf7a38-c18c-4aa3-b43d-3d3cea735964 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.246349 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d5bf7a38-c18c-4aa3-b43d-3d3cea735964 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.247105 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d5bf7a38-c18c-4aa3-b43d-3d3cea735964 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.247537 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d5bf7a38-c18c-4aa3-b43d-3d3cea735964 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.260686 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-d5bf7a38-c18c-4aa3-b43d-3d3cea735964 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d5bf7a38-c18c-4aa3-b43d-3d3cea735964 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: DELETE /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 HTTP/1.1 Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:37:00.262196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:37:00.263757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:37:00.263757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:37:00.263757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:37:00.263757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:37:00.263757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:37:00.263757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:37:00.263757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:37:00.263757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:37:00.263757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:37:00.263757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:37:00.263757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:37:00.263757 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '0940a4aa-71c4-4a96-8106-40dd8b012547'} Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:00.264621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:37:00.266086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:00.267805 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d5bf7a38-c18c-4aa3-b43d-3d3cea735964 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 404 to user: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:00.267805 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d5bf7a38-c18c-4aa3-b43d-3d3cea735964 tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 404 len: 111 microversion: 2.1 time: 0.029063 Jun 16 00:37:00.267805 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 488/998] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:37:00 2022] DELETE /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:00.272307 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e8d4e4e4-282c-456f-a1d0-550c29fc26bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:00.272921 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e8d4e4e4-282c-456f-a1d0-550c29fc26bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] [instance: 0940a4aa-71c4-4a96-8106-40dd8b012547] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:00.279367 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e8d4e4e4-282c-456f-a1d0-550c29fc26bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.279861 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e8d4e4e4-282c-456f-a1d0-550c29fc26bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.280626 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e8d4e4e4-282c-456f-a1d0-550c29fc26bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.281067 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e8d4e4e4-282c-456f-a1d0-550c29fc26bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.294727 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-e8d4e4e4-282c-456f-a1d0-550c29fc26bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] HTTP exception thrown: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e8d4e4e4-282c-456f-a1d0-550c29fc26bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Request method failure captured: Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 HTTP/1.1 Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqniv2tZfigRH-XN9GcZvfiMgpHv0HwLxEH4cw4c43LlSBk7Rw-RPa1XRKjXG0zSj3_RK19B4tVAfZSJnYhXjtj5u6QjPoucmaO9KS57OkRwr_1wyoXyTMnlEHZK-KpwHgj7d39kcHX3VrL6RbKFYWGElBrr7sa9jPFHk0cY-3p3-4-I Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:37:00.296256 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:37:00.297940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/def39ced63b64e3aa65c9542ae512e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:37:00.297940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:37:00.297940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: def39ced63b64e3aa65c9542ae512e7e Jun 16 00:37:00.297940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-948661713 Jun 16 00:37:00.297940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:37:00.297940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:37:00.297940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:37:00.297940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: f0c5a5705f34440abce48190674a76d5 Jun 16 00:37:00.297940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-AttachVolumeNegativeTest-948661713-project Jun 16 00:37:00.297940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:37:00.297940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:37:00.297940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '0940a4aa-71c4-4a96-8106-40dd8b012547'} Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:00.298881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. Jun 16 00:37:00.300928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:00.302232 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e8d4e4e4-282c-456f-a1d0-550c29fc26bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] Returning 404 to user: Instance 0940a4aa-71c4-4a96-8106-40dd8b012547 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:00.302232 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e8d4e4e4-282c-456f-a1d0-550c29fc26bf tempest-AttachVolumeNegativeTest-948661713 tempest-AttachVolumeNegativeTest-948661713-project] 10.222.0.44 "GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547" status: 404 len: 111 microversion: 2.1 time: 0.029197 Jun 16 00:37:00.302232 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 511/999] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:00 2022] GET /compute/v2.1/servers/0940a4aa-71c4-4a96-8106-40dd8b012547 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:37:10.900805 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-869a4a4f-d944-46ad-82e4-1c761ac0b74a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:10.901879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-869a4a4f-d944-46ad-82e4-1c761ac0b74a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:10.904574 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=20 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:10.905305 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:10.911642 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-869a4a4f-d944-46ad-82e4-1c761ac0b74a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.912107 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-869a4a4f-d944-46ad-82e4-1c761ac0b74a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.912879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-869a4a4f-d944-46ad-82e4-1c761ac0b74a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.913313 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-869a4a4f-d944-46ad-82e4-1c761ac0b74a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.944099 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-869a4a4f-d944-46ad-82e4-1c761ac0b74a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047223 Jun 16 00:37:10.944676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 489/1000] 10.222.0.44 () {60 vars in 1342 bytes} [Thu Jun 16 00:37:10 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:11.004355 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ce0e2454-ddf0-4505-ac2d-b4983b6488ea tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:11.004880 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ce0e2454-ddf0-4505-ac2d-b4983b6488ea tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:11.008276 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:11.010280 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:11.018458 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ce0e2454-ddf0-4505-ac2d-b4983b6488ea tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.019422 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ce0e2454-ddf0-4505-ac2d-b4983b6488ea tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.020293 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ce0e2454-ddf0-4505-ac2d-b4983b6488ea tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.020743 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ce0e2454-ddf0-4505-ac2d-b4983b6488ea tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.053862 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ce0e2454-ddf0-4505-ac2d-b4983b6488ea tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Going to try to terminate instance {{(pid=129466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:37:11.128479 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ce0e2454-ddf0-4505-ac2d-b4983b6488ea tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 204 len: 0 microversion: 2.20 time: 0.128282 Jun 16 00:37:11.129062 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 512/1001] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jun 16 00:37:10 2022] DELETE /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 00:37:11.140515 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-88d596eb-6656-493c-bc1e-3572e1eb41ee tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:11.141331 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-88d596eb-6656-493c-bc1e-3572e1eb41ee tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:11.148930 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-88d596eb-6656-493c-bc1e-3572e1eb41ee tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.149385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-88d596eb-6656-493c-bc1e-3572e1eb41ee tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.150182 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-88d596eb-6656-493c-bc1e-3572e1eb41ee tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.150623 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-88d596eb-6656-493c-bc1e-3572e1eb41ee tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.277149 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-88d596eb-6656-493c-bc1e-3572e1eb41ee tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:11.285656 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-88d596eb-6656-493c-bc1e-3572e1eb41ee tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:11.287152 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-88d596eb-6656-493c-bc1e-3572e1eb41ee tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:11.288339 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-88d596eb-6656-493c-bc1e-3572e1eb41ee tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.154555 Jun 16 00:37:11.288925 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 490/1002] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:11 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:12.307563 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8337b0ba-81ce-48a8-afd9-13a3fa9a75df tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:12.308274 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8337b0ba-81ce-48a8-afd9-13a3fa9a75df tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:12.314600 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8337b0ba-81ce-48a8-afd9-13a3fa9a75df tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:12.315044 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8337b0ba-81ce-48a8-afd9-13a3fa9a75df tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:12.315911 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8337b0ba-81ce-48a8-afd9-13a3fa9a75df tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:12.316344 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8337b0ba-81ce-48a8-afd9-13a3fa9a75df tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:12.444609 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8337b0ba-81ce-48a8-afd9-13a3fa9a75df tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:12.453201 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8337b0ba-81ce-48a8-afd9-13a3fa9a75df tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:12.454698 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8337b0ba-81ce-48a8-afd9-13a3fa9a75df tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:12.455901 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8337b0ba-81ce-48a8-afd9-13a3fa9a75df tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.152556 Jun 16 00:37:12.456998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 513/1003] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:12 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:13.474458 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-11c12db8-2432-44e7-b58e-f339251d2989 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:13.475074 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-11c12db8-2432-44e7-b58e-f339251d2989 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:13.481522 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-11c12db8-2432-44e7-b58e-f339251d2989 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:13.481967 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-11c12db8-2432-44e7-b58e-f339251d2989 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:13.482722 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-11c12db8-2432-44e7-b58e-f339251d2989 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:13.483153 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-11c12db8-2432-44e7-b58e-f339251d2989 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:13.612453 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-11c12db8-2432-44e7-b58e-f339251d2989 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:13.621208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-11c12db8-2432-44e7-b58e-f339251d2989 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:13.622637 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-11c12db8-2432-44e7-b58e-f339251d2989 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:13.623828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-11c12db8-2432-44e7-b58e-f339251d2989 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.153258 Jun 16 00:37:13.624381 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 491/1004] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:13 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:14.642275 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cd390725-1072-4bdc-9b71-5e7e808f112a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:14.642909 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-cd390725-1072-4bdc-9b71-5e7e808f112a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:14.649973 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cd390725-1072-4bdc-9b71-5e7e808f112a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:14.650426 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cd390725-1072-4bdc-9b71-5e7e808f112a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:14.651197 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cd390725-1072-4bdc-9b71-5e7e808f112a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:14.651659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cd390725-1072-4bdc-9b71-5e7e808f112a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:14.778667 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-cd390725-1072-4bdc-9b71-5e7e808f112a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:14.786702 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-cd390725-1072-4bdc-9b71-5e7e808f112a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:14.788293 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-cd390725-1072-4bdc-9b71-5e7e808f112a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:14.789447 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-cd390725-1072-4bdc-9b71-5e7e808f112a tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.151404 Jun 16 00:37:14.789986 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 514/1005] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:14 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:15.807014 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7bf16ebe-04bb-47bb-9bb7-2a6f3bb5b2b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:15.807632 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7bf16ebe-04bb-47bb-9bb7-2a6f3bb5b2b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:15.814106 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7bf16ebe-04bb-47bb-9bb7-2a6f3bb5b2b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:15.814551 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7bf16ebe-04bb-47bb-9bb7-2a6f3bb5b2b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:15.815301 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7bf16ebe-04bb-47bb-9bb7-2a6f3bb5b2b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:15.816376 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7bf16ebe-04bb-47bb-9bb7-2a6f3bb5b2b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:15.945913 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7bf16ebe-04bb-47bb-9bb7-2a6f3bb5b2b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:15.953826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7bf16ebe-04bb-47bb-9bb7-2a6f3bb5b2b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:15.955380 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-7bf16ebe-04bb-47bb-9bb7-2a6f3bb5b2b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:15.956553 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7bf16ebe-04bb-47bb-9bb7-2a6f3bb5b2b4 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1723 microversion: 2.20 time: 0.153468 Jun 16 00:37:15.957098 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 492/1006] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:15 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:16.976922 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-72307e1b-5f29-4381-b20b-427723b7d999 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:16.978787 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-72307e1b-5f29-4381-b20b-427723b7d999 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:16.987208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-72307e1b-5f29-4381-b20b-427723b7d999 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:16.988109 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-72307e1b-5f29-4381-b20b-427723b7d999 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:16.990096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-72307e1b-5f29-4381-b20b-427723b7d999 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:16.990910 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-72307e1b-5f29-4381-b20b-427723b7d999 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:17.066931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-72307e1b-5f29-4381-b20b-427723b7d999 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:17.076979 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-72307e1b-5f29-4381-b20b-427723b7d999 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:17.078775 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-72307e1b-5f29-4381-b20b-427723b7d999 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:17.080106 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-72307e1b-5f29-4381-b20b-427723b7d999 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1655 microversion: 2.20 time: 0.108463 Jun 16 00:37:17.081615 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 493/1007] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:16 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1655 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:37:17.096383 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-e072d3e5-8ec3-46c1-9baf-a429a2665367 req-dfe2fd7f-e870-4461-9e1b-b897c300e2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a5a227f-6658-4f75-9193-65c781e2748f", "name": "network-vif-deleted", "tag": "c16f9b3b-e924-4296-9815-07d0ab5a729b"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:17.105912 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-e072d3e5-8ec3-46c1-9baf-a429a2665367 req-dfe2fd7f-e870-4461-9e1b-b897c300e2c6 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:17.106353 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-e072d3e5-8ec3-46c1-9baf-a429a2665367 req-dfe2fd7f-e870-4461-9e1b-b897c300e2c6 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:17.118552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-e072d3e5-8ec3-46c1-9baf-a429a2665367 req-dfe2fd7f-e870-4461-9e1b-b897c300e2c6 service nova] Creating event network-vif-deleted:c16f9b3b-e924-4296-9815-07d0ab5a729b for instance 3a5a227f-6658-4f75-9193-65c781e2748f on hv-cinder-84327 Jun 16 00:37:17.123855 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-e072d3e5-8ec3-46c1-9baf-a429a2665367 req-dfe2fd7f-e870-4461-9e1b-b897c300e2c6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182675 Jun 16 00:37:17.124552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 515/1008] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:18.099625 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-71d71957-419e-4120-b487-d01f725c12d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:18.100175 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-71d71957-419e-4120-b487-d01f725c12d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:18.106555 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-71d71957-419e-4120-b487-d01f725c12d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:18.107003 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-71d71957-419e-4120-b487-d01f725c12d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:18.107790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-71d71957-419e-4120-b487-d01f725c12d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:18.108222 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-71d71957-419e-4120-b487-d01f725c12d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:18.173327 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-71d71957-419e-4120-b487-d01f725c12d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:18.181706 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-71d71957-419e-4120-b487-d01f725c12d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:18.183172 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-71d71957-419e-4120-b487-d01f725c12d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:18.184336 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-71d71957-419e-4120-b487-d01f725c12d0 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1655 microversion: 2.20 time: 0.089154 Jun 16 00:37:18.184882 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 494/1009] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:18 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:19.202940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d8a009c9-7ef1-499b-89c5-728f14333b03 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:19.203636 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d8a009c9-7ef1-499b-89c5-728f14333b03 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:19.210808 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d8a009c9-7ef1-499b-89c5-728f14333b03 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:19.211253 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d8a009c9-7ef1-499b-89c5-728f14333b03 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:19.212036 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d8a009c9-7ef1-499b-89c5-728f14333b03 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:19.212470 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d8a009c9-7ef1-499b-89c5-728f14333b03 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:19.274909 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d8a009c9-7ef1-499b-89c5-728f14333b03 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:19.282673 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d8a009c9-7ef1-499b-89c5-728f14333b03 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:19.284778 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d8a009c9-7ef1-499b-89c5-728f14333b03 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:19.285922 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d8a009c9-7ef1-499b-89c5-728f14333b03 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1366 microversion: 2.20 time: 0.087229 Jun 16 00:37:19.286465 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 516/1010] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:19 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:20.303481 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8ae3c637-15c1-4682-9b15-4dc42ee1d38c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:20.304136 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8ae3c637-15c1-4682-9b15-4dc42ee1d38c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:20.310753 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8ae3c637-15c1-4682-9b15-4dc42ee1d38c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:20.311196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8ae3c637-15c1-4682-9b15-4dc42ee1d38c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:20.311988 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8ae3c637-15c1-4682-9b15-4dc42ee1d38c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:20.312422 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8ae3c637-15c1-4682-9b15-4dc42ee1d38c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:20.372337 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8ae3c637-15c1-4682-9b15-4dc42ee1d38c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:20.380671 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8ae3c637-15c1-4682-9b15-4dc42ee1d38c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:20.382152 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8ae3c637-15c1-4682-9b15-4dc42ee1d38c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:20.383264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8ae3c637-15c1-4682-9b15-4dc42ee1d38c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1366 microversion: 2.20 time: 0.083694 Jun 16 00:37:20.383849 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 495/1011] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:20 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:21.401580 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:21.402180 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:21.408721 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:21.409664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:21.410418 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:21.410848 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:21.440534 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:21.440971 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:21.441408 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.objects.instance [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lazy-loading 'fault' on Instance uuid 3a5a227f-6658-4f75-9193-65c781e2748f {{(pid=129466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:37:21.481217 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:21.488940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:21.490417 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6c145cb49f54dd88307f416ff1bb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a869108ba4446c4b767d186c5db253f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:21.491555 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-43f11742-a1d3-4673-a2c6-4336cfb329bd tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 200 len: 1371 microversion: 2.20 time: 0.093769 Jun 16 00:37:21.492123 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 517/1012] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:21 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:22.510093 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2510aff5-1b97-4b96-aafe-ce000f6a2911 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:22.510571 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2510aff5-1b97-4b96-aafe-ce000f6a2911 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:22.516628 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2510aff5-1b97-4b96-aafe-ce000f6a2911 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:22.517344 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2510aff5-1b97-4b96-aafe-ce000f6a2911 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:22.518112 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2510aff5-1b97-4b96-aafe-ce000f6a2911 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:22.518546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2510aff5-1b97-4b96-aafe-ce000f6a2911 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:22.531579 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-2510aff5-1b97-4b96-aafe-ce000f6a2911 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] HTTP exception thrown: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2510aff5-1b97-4b96-aafe-ce000f6a2911 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Request method failure captured: Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f HTTP/1.1 Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnit5_a8sxQchl7G3i9_poufKrzSL5d0EqtQFOC78BPlaqkrNezLxV-10em7E1imQl5m78hfUzqMpM1Lc8QHeVbkCuBRTUU3fndr1S1fSosEZ9vcG0hfnhf2R8TiT7Zcgvd7czVJJiYefx_FHutlMUrcxkSFimFm0Rg3_tSZWYTVGBw Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 0a869108ba4446c4b767d186c5db253f Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:37:22.533162 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:37:22.534564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a869108ba4446c4b767d186c5db253f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:37:22.534564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:22.534564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 0a869108ba4446c4b767d186c5db253f Jun 16 00:37:22.534564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:22.534564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeShelveTestJSON-921110731-project Jun 16 00:37:22.534564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:37:22.534564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:37:22.534564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: a6c145cb49f54dd88307f416ff1bb92b Jun 16 00:37:22.534564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeShelveTestJSON-921110731-project Jun 16 00:37:22.534564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:37:22.534564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:22.534564 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '3a5a227f-6658-4f75-9193-65c781e2748f'} Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:22.535351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:22.536743 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:22.537819 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2510aff5-1b97-4b96-aafe-ce000f6a2911 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Returning 404 to user: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:22.537819 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2510aff5-1b97-4b96-aafe-ce000f6a2911 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 404 len: 111 microversion: 2.20 time: 0.028665 Jun 16 00:37:22.537819 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 496/1013] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:22 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:37:22.543531 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-65db5546-a992-44de-bdba-a48f5355087c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '.version_select at 0x7f9573c249d0>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:22.561263 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-65db5546-a992-44de-bdba-a48f5355087c tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-942241172" status: 204 len: 0 microversion: 2.20 time: 0.021490 Jun 16 00:37:22.561841 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 518/1014] 10.222.0.44 () {60 vars in 1258 bytes} [Thu Jun 16 00:37:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-942241172 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 00:37:28.530614 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4559114b-6d5c-45e2-9e93-215ab3688f02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:28.531123 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4559114b-6d5c-45e2-9e93-215ab3688f02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:28.537625 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4559114b-6d5c-45e2-9e93-215ab3688f02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:28.538074 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4559114b-6d5c-45e2-9e93-215ab3688f02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:28.538871 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4559114b-6d5c-45e2-9e93-215ab3688f02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:28.539308 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4559114b-6d5c-45e2-9e93-215ab3688f02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:28.552809 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-4559114b-6d5c-45e2-9e93-215ab3688f02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] HTTP exception thrown: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4559114b-6d5c-45e2-9e93-215ab3688f02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Request method failure captured: Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: DELETE /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f HTTP/1.1 Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnit5_a8sxQchl7G3i9_poufKrzSL5d0EqtQFOC78BPlaqkrNezLxV-10em7E1imQl5m78hfUzqMpM1Lc8QHeVbkCuBRTUU3fndr1S1fSosEZ9vcG0hfnhf2R8TiT7Zcgvd7czVJJiYefx_FHutlMUrcxkSFimFm0Rg3_tSZWYTVGBw Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 0a869108ba4446c4b767d186c5db253f Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:37:28.554330 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:37:28.556178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a869108ba4446c4b767d186c5db253f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:37:28.556178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:28.556178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 0a869108ba4446c4b767d186c5db253f Jun 16 00:37:28.556178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:28.556178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeShelveTestJSON-921110731-project Jun 16 00:37:28.556178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:37:28.556178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:37:28.556178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: a6c145cb49f54dd88307f416ff1bb92b Jun 16 00:37:28.556178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeShelveTestJSON-921110731-project Jun 16 00:37:28.556178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:37:28.556178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:28.556178 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '3a5a227f-6658-4f75-9193-65c781e2748f'} Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:28.557264 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:28.558958 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:28.560698 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4559114b-6d5c-45e2-9e93-215ab3688f02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Returning 404 to user: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:28.560698 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4559114b-6d5c-45e2-9e93-215ab3688f02 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 404 len: 111 microversion: 2.20 time: 0.029044 Jun 16 00:37:28.560698 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 497/1015] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jun 16 00:37:28 2022] DELETE /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:37:28.564523 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cc6a1ed7-e5a6-4b66-8237-75c6698c9914 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:28.565788 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-cc6a1ed7-e5a6-4b66-8237-75c6698c9914 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 3a5a227f-6658-4f75-9193-65c781e2748f] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:28.572575 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cc6a1ed7-e5a6-4b66-8237-75c6698c9914 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:28.573024 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cc6a1ed7-e5a6-4b66-8237-75c6698c9914 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:28.573791 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cc6a1ed7-e5a6-4b66-8237-75c6698c9914 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:28.574230 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cc6a1ed7-e5a6-4b66-8237-75c6698c9914 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:28.586913 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-cc6a1ed7-e5a6-4b66-8237-75c6698c9914 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] HTTP exception thrown: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cc6a1ed7-e5a6-4b66-8237-75c6698c9914 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Request method failure captured: Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f HTTP/1.1 Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnit5_a8sxQchl7G3i9_poufKrzSL5d0EqtQFOC78BPlaqkrNezLxV-10em7E1imQl5m78hfUzqMpM1Lc8QHeVbkCuBRTUU3fndr1S1fSosEZ9vcG0hfnhf2R8TiT7Zcgvd7czVJJiYefx_FHutlMUrcxkSFimFm0Rg3_tSZWYTVGBw Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 0a869108ba4446c4b767d186c5db253f Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:37:28.588558 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:37:28.590237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a869108ba4446c4b767d186c5db253f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:37:28.590237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:28.590237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 0a869108ba4446c4b767d186c5db253f Jun 16 00:37:28.590237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:28.590237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-AttachVolumeShelveTestJSON-921110731-project Jun 16 00:37:28.590237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:37:28.590237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:37:28.590237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: a6c145cb49f54dd88307f416ff1bb92b Jun 16 00:37:28.590237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-921110731-project Jun 16 00:37:28.590237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:37:28.590237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:28.590237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '3a5a227f-6658-4f75-9193-65c781e2748f'} Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:28.591168 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. Jun 16 00:37:28.592512 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:28.593769 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cc6a1ed7-e5a6-4b66-8237-75c6698c9914 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Returning 404 to user: Instance 3a5a227f-6658-4f75-9193-65c781e2748f could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:28.593769 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-cc6a1ed7-e5a6-4b66-8237-75c6698c9914 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f" status: 404 len: 111 microversion: 2.20 time: 0.029756 Jun 16 00:37:28.593769 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 519/1016] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:28 2022] GET /compute/v2.1/servers/3a5a227f-6658-4f75-9193-65c781e2748f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:37:29.726917 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9a6fec7a-b006-479c-b4ea-d67dddafa0f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:29.727512 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9a6fec7a-b006-479c-b4ea-d67dddafa0f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:29.734198 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9a6fec7a-b006-479c-b4ea-d67dddafa0f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:29.734639 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9a6fec7a-b006-479c-b4ea-d67dddafa0f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:29.735392 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9a6fec7a-b006-479c-b4ea-d67dddafa0f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:29.735845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9a6fec7a-b006-479c-b4ea-d67dddafa0f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:29.749481 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-9a6fec7a-b006-479c-b4ea-d67dddafa0f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] HTTP exception thrown: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9a6fec7a-b006-479c-b4ea-d67dddafa0f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Request method failure captured: Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: DELETE /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be HTTP/1.1 Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnit5_a8sxQchl7G3i9_poufKrzSL5d0EqtQFOC78BPlaqkrNezLxV-10em7E1imQl5m78hfUzqMpM1Lc8QHeVbkCuBRTUU3fndr1S1fSosEZ9vcG0hfnhf2R8TiT7Zcgvd7czVJJiYefx_FHutlMUrcxkSFimFm0Rg3_tSZWYTVGBw Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 0a869108ba4446c4b767d186c5db253f Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:37:29.750995 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:37:29.753265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a869108ba4446c4b767d186c5db253f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:37:29.753265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:29.753265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 0a869108ba4446c4b767d186c5db253f Jun 16 00:37:29.753265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:29.753265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeShelveTestJSON-921110731-project Jun 16 00:37:29.753265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:37:29.753265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:37:29.753265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: a6c145cb49f54dd88307f416ff1bb92b Jun 16 00:37:29.753265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeShelveTestJSON-921110731-project Jun 16 00:37:29.753265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:37:29.753265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:37:29.753265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '7b84afb6-466c-477a-9339-b4a0ecef36be'} Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:29.754348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:37:29.756046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:37:29.757692 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9a6fec7a-b006-479c-b4ea-d67dddafa0f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Returning 404 to user: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:29.757692 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9a6fec7a-b006-479c-b4ea-d67dddafa0f5 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 404 len: 111 microversion: 2.20 time: 0.029355 Jun 16 00:37:29.757692 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 498/1017] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jun 16 00:37:29 2022] DELETE /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:37:29.761212 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-446790f6-e8f3-412b-8475-657ea435c390 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:29.761821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-446790f6-e8f3-412b-8475-657ea435c390 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] [instance: 7b84afb6-466c-477a-9339-b4a0ecef36be] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:29.768492 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-446790f6-e8f3-412b-8475-657ea435c390 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:29.768940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-446790f6-e8f3-412b-8475-657ea435c390 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:29.769706 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-446790f6-e8f3-412b-8475-657ea435c390 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:29.770139 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-446790f6-e8f3-412b-8475-657ea435c390 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:29.783660 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-446790f6-e8f3-412b-8475-657ea435c390 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] HTTP exception thrown: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-446790f6-e8f3-412b-8475-657ea435c390 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Request method failure captured: Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be HTTP/1.1 Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnit5_a8sxQchl7G3i9_poufKrzSL5d0EqtQFOC78BPlaqkrNezLxV-10em7E1imQl5m78hfUzqMpM1Lc8QHeVbkCuBRTUU3fndr1S1fSosEZ9vcG0hfnhf2R8TiT7Zcgvd7czVJJiYefx_FHutlMUrcxkSFimFm0Rg3_tSZWYTVGBw Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 0a869108ba4446c4b767d186c5db253f Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:37:29.785182 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:37:29.786664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0a869108ba4446c4b767d186c5db253f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0a869108ba4446c4b767d186c5db253f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:37:29.786664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:29.786664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 0a869108ba4446c4b767d186c5db253f Jun 16 00:37:29.786664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-921110731 Jun 16 00:37:29.786664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-AttachVolumeShelveTestJSON-921110731-project Jun 16 00:37:29.786664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:37:29.786664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:37:29.786664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: a6c145cb49f54dd88307f416ff1bb92b Jun 16 00:37:29.786664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-921110731-project Jun 16 00:37:29.786664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:37:29.786664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:37:29.786664 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '7b84afb6-466c-477a-9339-b4a0ecef36be'} Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:37:29.787386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. Jun 16 00:37:29.789240 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:37:29.790573 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-446790f6-e8f3-412b-8475-657ea435c390 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] Returning 404 to user: Instance 7b84afb6-466c-477a-9339-b4a0ecef36be could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:37:29.790573 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-446790f6-e8f3-412b-8475-657ea435c390 tempest-AttachVolumeShelveTestJSON-921110731 tempest-AttachVolumeShelveTestJSON-921110731-project] 10.222.0.44 "GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be" status: 404 len: 111 microversion: 2.20 time: 0.029164 Jun 16 00:37:29.790573 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 520/1018] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:29 2022] GET /compute/v2.1/servers/7b84afb6-466c-477a-9339-b4a0ecef36be => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:37:41.428164 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c806d014-92ba-4f67-b40c-bce6f8664f14 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:41.428705 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c806d014-92ba-4f67-b40c-bce6f8664f14 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:41.431001 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=20 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:41.431647 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=48 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:41.437469 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c806d014-92ba-4f67-b40c-bce6f8664f14 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:41.437916 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c806d014-92ba-4f67-b40c-bce6f8664f14 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:41.438670 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c806d014-92ba-4f67-b40c-bce6f8664f14 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:41.439154 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c806d014-92ba-4f67-b40c-bce6f8664f14 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:41.516704 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.objects.instance [None req-c806d014-92ba-4f67-b40c-bce6f8664f14 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lazy-loading 'services' on Instance uuid b3f39b67-fe8c-4a0a-8ac8-ca589391af83 {{(pid=129465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:37:41.588226 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c806d014-92ba-4f67-b40c-bce6f8664f14 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/os-volume_attachments/76be2891-772e-47e8-93fb-1ba953ff8ffc" status: 202 len: 0 microversion: 2.1 time: 0.164338 Jun 16 00:37:41.588822 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 499/1019] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 16 00:37:41 2022] DELETE /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/os-volume_attachments/76be2891-772e-47e8-93fb-1ba953ff8ffc => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:37:43.758308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-479c0032-a9ca-4856-8224-32001dc369a2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:43.760972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:43.761974 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:43.768590 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-479c0032-a9ca-4856-8224-32001dc369a2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:43.769039 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-479c0032-a9ca-4856-8224-32001dc369a2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:43.796960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-479c0032-a9ca-4856-8224-32001dc369a2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Going to try to stop instance {{(pid=129466) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 00:37:43.840781 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-479c0032-a9ca-4856-8224-32001dc369a2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "POST /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/action" status: 202 len: 0 microversion: 2.1 time: 0.086261 Jun 16 00:37:43.841672 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 521/1020] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:37:43 2022] POST /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:37:43.850971 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bd777bee-a358-439f-86c5-990ba7c92352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:43.851883 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bd777bee-a358-439f-86c5-990ba7c92352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:43.858608 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bd777bee-a358-439f-86c5-990ba7c92352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:43.859063 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bd777bee-a358-439f-86c5-990ba7c92352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:43.859945 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bd777bee-a358-439f-86c5-990ba7c92352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:43.860384 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bd777bee-a358-439f-86c5-990ba7c92352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:43.999853 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bd777bee-a358-439f-86c5-990ba7c92352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:44.008100 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bd777bee-a358-439f-86c5-990ba7c92352 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1676 microversion: 2.1 time: 0.161829 Jun 16 00:37:44.008771 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 500/1021] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:43 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:45.027098 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-3036e220-9533-4ee6-84c2-b9f84a4ee435 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:45.027746 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-3036e220-9533-4ee6-84c2-b9f84a4ee435 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:45.034629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3036e220-9533-4ee6-84c2-b9f84a4ee435 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:45.035083 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3036e220-9533-4ee6-84c2-b9f84a4ee435 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:45.035879 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3036e220-9533-4ee6-84c2-b9f84a4ee435 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:45.036324 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-3036e220-9533-4ee6-84c2-b9f84a4ee435 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:45.164624 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-3036e220-9533-4ee6-84c2-b9f84a4ee435 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:45.172086 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-3036e220-9533-4ee6-84c2-b9f84a4ee435 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1676 microversion: 2.1 time: 0.149817 Jun 16 00:37:45.172646 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 522/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:45 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:46.189070 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2ebd8930-1751-410a-9649-a81d7c031cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:46.189683 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2ebd8930-1751-410a-9649-a81d7c031cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:46.196182 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2ebd8930-1751-410a-9649-a81d7c031cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:46.196633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2ebd8930-1751-410a-9649-a81d7c031cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:46.197430 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2ebd8930-1751-410a-9649-a81d7c031cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:46.197872 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2ebd8930-1751-410a-9649-a81d7c031cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:46.328814 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2ebd8930-1751-410a-9649-a81d7c031cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:46.336981 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2ebd8930-1751-410a-9649-a81d7c031cb0 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1676 microversion: 2.1 time: 0.151704 Jun 16 00:37:46.337483 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 501/1023] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:46 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:47.353872 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2009a6b6-1013-4b71-87d5-57646b72e61a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:47.354495 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2009a6b6-1013-4b71-87d5-57646b72e61a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:47.361623 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2009a6b6-1013-4b71-87d5-57646b72e61a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:47.362123 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2009a6b6-1013-4b71-87d5-57646b72e61a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:47.362847 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2009a6b6-1013-4b71-87d5-57646b72e61a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:47.363290 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2009a6b6-1013-4b71-87d5-57646b72e61a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:47.488824 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2009a6b6-1013-4b71-87d5-57646b72e61a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:47.496248 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2009a6b6-1013-4b71-87d5-57646b72e61a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1676 microversion: 2.1 time: 0.146256 Jun 16 00:37:47.496818 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 523/1024] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:47 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:48.513403 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-925a1a85-b487-4e77-92db-633604ce0886 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:48.514012 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-925a1a85-b487-4e77-92db-633604ce0886 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:48.520719 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-925a1a85-b487-4e77-92db-633604ce0886 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:48.521169 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-925a1a85-b487-4e77-92db-633604ce0886 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:48.521934 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-925a1a85-b487-4e77-92db-633604ce0886 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:48.522374 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-925a1a85-b487-4e77-92db-633604ce0886 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:48.656035 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-925a1a85-b487-4e77-92db-633604ce0886 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:48.664283 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-925a1a85-b487-4e77-92db-633604ce0886 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1676 microversion: 2.1 time: 0.154637 Jun 16 00:37:48.664855 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 502/1025] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:48 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:49.681899 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-62efbf65-9875-4e60-b373-6ffdd7ae0499 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:49.682646 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-62efbf65-9875-4e60-b373-6ffdd7ae0499 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:49.689117 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-62efbf65-9875-4e60-b373-6ffdd7ae0499 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:49.689566 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-62efbf65-9875-4e60-b373-6ffdd7ae0499 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:49.690338 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-62efbf65-9875-4e60-b373-6ffdd7ae0499 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:49.690775 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-62efbf65-9875-4e60-b373-6ffdd7ae0499 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:49.820360 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-62efbf65-9875-4e60-b373-6ffdd7ae0499 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:49.827750 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-62efbf65-9875-4e60-b373-6ffdd7ae0499 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1676 microversion: 2.1 time: 0.149977 Jun 16 00:37:49.828313 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 524/1026] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:49 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:50.844587 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bdd2c197-b4c9-423f-a091-1a6018adea3b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:50.845219 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bdd2c197-b4c9-423f-a091-1a6018adea3b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:50.851970 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bdd2c197-b4c9-423f-a091-1a6018adea3b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:50.852508 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bdd2c197-b4c9-423f-a091-1a6018adea3b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:50.853196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bdd2c197-b4c9-423f-a091-1a6018adea3b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:50.853628 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bdd2c197-b4c9-423f-a091-1a6018adea3b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:50.992429 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bdd2c197-b4c9-423f-a091-1a6018adea3b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:51.000146 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bdd2c197-b4c9-423f-a091-1a6018adea3b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1676 microversion: 2.1 time: 0.159467 Jun 16 00:37:51.000718 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 503/1027] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:50 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:52.018077 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-78efb3a4-8dae-4114-bec6-d5fa8dd4996e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:52.018688 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-78efb3a4-8dae-4114-bec6-d5fa8dd4996e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:52.025255 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78efb3a4-8dae-4114-bec6-d5fa8dd4996e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:52.025713 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78efb3a4-8dae-4114-bec6-d5fa8dd4996e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:52.026501 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78efb3a4-8dae-4114-bec6-d5fa8dd4996e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:52.026922 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78efb3a4-8dae-4114-bec6-d5fa8dd4996e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:52.160308 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-78efb3a4-8dae-4114-bec6-d5fa8dd4996e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:52.168303 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-78efb3a4-8dae-4114-bec6-d5fa8dd4996e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1676 microversion: 2.1 time: 0.154835 Jun 16 00:37:52.168861 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 525/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:52 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:52.408587 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:37:52.408784 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Thu Jun 16 00:37:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:37:53.185476 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e82346c3-b29b-4cb2-8045-1878bd53428f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:53.186855 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e82346c3-b29b-4cb2-8045-1878bd53428f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:53.194174 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e82346c3-b29b-4cb2-8045-1878bd53428f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:53.194956 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e82346c3-b29b-4cb2-8045-1878bd53428f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:53.195978 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e82346c3-b29b-4cb2-8045-1878bd53428f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:53.197150 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e82346c3-b29b-4cb2-8045-1878bd53428f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:53.340486 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e82346c3-b29b-4cb2-8045-1878bd53428f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:53.348317 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e82346c3-b29b-4cb2-8045-1878bd53428f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1676 microversion: 2.1 time: 0.166965 Jun 16 00:37:53.348889 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 504/1029] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:53 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:54.366972 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-26961a92-9463-4421-a544-a91d732e76bc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:54.370947 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-26961a92-9463-4421-a544-a91d732e76bc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:54.378639 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-26961a92-9463-4421-a544-a91d732e76bc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:54.379121 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-26961a92-9463-4421-a544-a91d732e76bc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:54.379957 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-26961a92-9463-4421-a544-a91d732e76bc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:54.380562 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-26961a92-9463-4421-a544-a91d732e76bc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:54.527151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-26961a92-9463-4421-a544-a91d732e76bc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:54.535443 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-26961a92-9463-4421-a544-a91d732e76bc tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1676 microversion: 2.1 time: 0.173071 Jun 16 00:37:54.536135 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 526/1030] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:54 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:55.552972 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-626c4977-5284-4e4f-916c-1a288601997a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:55.553573 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-626c4977-5284-4e4f-916c-1a288601997a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:55.560575 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-626c4977-5284-4e4f-916c-1a288601997a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:55.561213 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-626c4977-5284-4e4f-916c-1a288601997a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:55.562076 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-626c4977-5284-4e4f-916c-1a288601997a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:55.562726 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-626c4977-5284-4e4f-916c-1a288601997a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:55.695354 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-626c4977-5284-4e4f-916c-1a288601997a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:55.704014 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-626c4977-5284-4e4f-916c-1a288601997a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1676 microversion: 2.1 time: 0.154696 Jun 16 00:37:55.704578 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 505/1031] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:55 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:56.721309 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c3f1f0d9-dca7-42c3-9a26-a37ec2c1048b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:56.721921 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c3f1f0d9-dca7-42c3-9a26-a37ec2c1048b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:56.728356 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c3f1f0d9-dca7-42c3-9a26-a37ec2c1048b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:56.728806 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c3f1f0d9-dca7-42c3-9a26-a37ec2c1048b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:56.729598 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c3f1f0d9-dca7-42c3-9a26-a37ec2c1048b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:56.730038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c3f1f0d9-dca7-42c3-9a26-a37ec2c1048b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:56.862919 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c3f1f0d9-dca7-42c3-9a26-a37ec2c1048b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:56.870243 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c3f1f0d9-dca7-42c3-9a26-a37ec2c1048b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1676 microversion: 2.1 time: 0.152844 Jun 16 00:37:56.870788 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 527/1032] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:56 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:57.894166 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-df9ad041-5546-40be-adb0-1ded4def7c69 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:57.894841 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-df9ad041-5546-40be-adb0-1ded4def7c69 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:57.901441 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-df9ad041-5546-40be-adb0-1ded4def7c69 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:57.901888 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-df9ad041-5546-40be-adb0-1ded4def7c69 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:57.902654 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-df9ad041-5546-40be-adb0-1ded4def7c69 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:57.903267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-df9ad041-5546-40be-adb0-1ded4def7c69 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:58.030022 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-df9ad041-5546-40be-adb0-1ded4def7c69 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:58.037927 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-df9ad041-5546-40be-adb0-1ded4def7c69 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1653 microversion: 2.1 time: 0.147928 Jun 16 00:37:58.038494 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 506/1033] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:57 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1653 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:58.054636 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4911f431-848e-4f25-8bda-56a80f499e98 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:58.061267 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4911f431-848e-4f25-8bda-56a80f499e98 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:58.061717 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4911f431-848e-4f25-8bda-56a80f499e98 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:58.082773 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4911f431-848e-4f25-8bda-56a80f499e98 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Going to try to start instance {{(pid=129466) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 00:37:58.123677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4911f431-848e-4f25-8bda-56a80f499e98 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "POST /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/action" status: 202 len: 0 microversion: 2.1 time: 0.072673 Jun 16 00:37:58.124257 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 528/1034] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jun 16 00:37:58 2022] POST /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:37:58.132473 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d17c9213-ce61-4587-b457-1127af686ff2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:58.133081 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d17c9213-ce61-4587-b457-1127af686ff2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:58.139107 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d17c9213-ce61-4587-b457-1127af686ff2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:58.139553 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d17c9213-ce61-4587-b457-1127af686ff2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:58.140358 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d17c9213-ce61-4587-b457-1127af686ff2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:58.140901 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d17c9213-ce61-4587-b457-1127af686ff2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:58.300152 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-d17c9213-ce61-4587-b457-1127af686ff2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:58.307700 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d17c9213-ce61-4587-b457-1127af686ff2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1662 microversion: 2.1 time: 0.178990 Jun 16 00:37:58.308269 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 507/1035] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:58 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1662 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:59.327904 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b898d248-7f0f-4e46-b4a1-a00c9b7635aa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:59.329316 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b898d248-7f0f-4e46-b4a1-a00c9b7635aa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:59.339153 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b898d248-7f0f-4e46-b4a1-a00c9b7635aa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:59.339643 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b898d248-7f0f-4e46-b4a1-a00c9b7635aa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:59.340658 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b898d248-7f0f-4e46-b4a1-a00c9b7635aa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:59.341138 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b898d248-7f0f-4e46-b4a1-a00c9b7635aa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:59.488473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b898d248-7f0f-4e46-b4a1-a00c9b7635aa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:59.495889 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b898d248-7f0f-4e46-b4a1-a00c9b7635aa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1662 microversion: 2.1 time: 0.173509 Jun 16 00:37:59.496445 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 529/1036] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:59 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1662 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:38:00.514201 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a806e188-fa49-4698-8297-3b02f90df42a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:00.515579 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a806e188-fa49-4698-8297-3b02f90df42a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:00.523103 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a806e188-fa49-4698-8297-3b02f90df42a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:00.523775 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a806e188-fa49-4698-8297-3b02f90df42a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:00.524755 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a806e188-fa49-4698-8297-3b02f90df42a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:00.525351 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a806e188-fa49-4698-8297-3b02f90df42a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:00.702335 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a806e188-fa49-4698-8297-3b02f90df42a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:00.710726 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a806e188-fa49-4698-8297-3b02f90df42a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1666 microversion: 2.1 time: 0.201369 Jun 16 00:38:00.711294 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 508/1037] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:00 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1666 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:42.999164 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=18 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:43.000018 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:43.165658 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-53c8c7aa-2c4e-40b0-b545-2da65fb30dc5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Action: 'create', calling method: .version_select at 0x7f9573df1dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1794881766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQBkdPoDigv8ExQajQdyFhxP8mv5baeMXbGOpUWaUQukfcDk533Mo/SpZvjI1LRrrtcNJGfWCKTrI/DSX8MzwBOg90FAOqqFz+EiWRakLV2Ok55zNhWOKlgXaVwVHfpEw=="}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:43.179382 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-53c8c7aa-2c4e-40b0-b545-2da65fb30dc5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Getting quotas for project e0d870e67f68470988dd26ac7aef3fec. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:38:43.183232 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-53c8c7aa-2c4e-40b0-b545-2da65fb30dc5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Getting quotas for user c9f93af4621b4a9db098c299c9e32c20 and project e0d870e67f68470988dd26ac7aef3fec. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:38:43.205122 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-53c8c7aa-2c4e-40b0-b545-2da65fb30dc5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.211091 Jun 16 00:38:43.205719 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 530/1038] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 16 00:38:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:49.334534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1914118864", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:49.340552 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=20 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:49.341387 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:49.384718 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] validate_networks() for None {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:38:49.897305 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:38:49.897726 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:38:49.898323 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:38:49.898576 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:38:49.898980 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:38:49.909006 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:49.909488 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:49.910314 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:49.910746 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:49.927510 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Getting quotas for project 8bf0fd6a893b43f3a62537f9abb82f34. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:38:49.931402 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Getting quotas for user 59eccc7e263340c98313f65496e89fe3 and project 8bf0fd6a893b43f3a62537f9abb82f34. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:38:49.942955 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:38:49.945288 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:38:49.990008 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7809f3bb-0c69-4873-a094-64355de9bc22 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659754 Jun 16 00:38:49.990933 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 509/1039] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:38:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:38:50.001020 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d7960811-2665-4993-b14d-99ebf327ac13 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:50.001628 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d7960811-2665-4993-b14d-99ebf327ac13 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:50.059583 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d7960811-2665-4993-b14d-99ebf327ac13 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:50.067520 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d7960811-2665-4993-b14d-99ebf327ac13 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1215 microversion: 2.1 time: 0.070858 Jun 16 00:38:50.068289 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 531/1040] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:49 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:51.086231 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a177e47a-cbb4-4342-b748-33a62f7218e4 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:51.086850 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a177e47a-cbb4-4342-b748-33a62f7218e4 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:51.093048 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a177e47a-cbb4-4342-b748-33a62f7218e4 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:51.093492 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a177e47a-cbb4-4342-b748-33a62f7218e4 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:51.094284 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a177e47a-cbb4-4342-b748-33a62f7218e4 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:51.094758 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a177e47a-cbb4-4342-b748-33a62f7218e4 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:51.167508 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a177e47a-cbb4-4342-b748-33a62f7218e4 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:51.176516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a177e47a-cbb4-4342-b748-33a62f7218e4 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1275 microversion: 2.1 time: 0.095804 Jun 16 00:38:51.177457 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 510/1041] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:51 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:52.194139 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-78763892-a6a0-454c-8b53-2dd146174fb0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:52.194654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-78763892-a6a0-454c-8b53-2dd146174fb0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:52.201217 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78763892-a6a0-454c-8b53-2dd146174fb0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:52.201666 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78763892-a6a0-454c-8b53-2dd146174fb0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:52.202441 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78763892-a6a0-454c-8b53-2dd146174fb0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:52.202881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-78763892-a6a0-454c-8b53-2dd146174fb0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:52.420645 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-78763892-a6a0-454c-8b53-2dd146174fb0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:52.429023 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-78763892-a6a0-454c-8b53-2dd146174fb0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1315 microversion: 2.1 time: 0.238836 Jun 16 00:38:52.429672 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 532/1042] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:52 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:52.727188 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-d12fb4b9-9330-47ee-ac54-5c5ff00dfa40 req-11d37d52-c231-4acd-ab1a-ce97a419d204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4cfb681-1ffb-46ac-904f-0cbe1d44eaca", "tag": "f08ebd88-3299-497a-a843-45bd052461ec"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:52.736197 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-d12fb4b9-9330-47ee-ac54-5c5ff00dfa40 req-11d37d52-c231-4acd-ab1a-ce97a419d204 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:52.736648 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-d12fb4b9-9330-47ee-ac54-5c5ff00dfa40 req-11d37d52-c231-4acd-ab1a-ce97a419d204 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:52.754505 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-d12fb4b9-9330-47ee-ac54-5c5ff00dfa40 req-11d37d52-c231-4acd-ab1a-ce97a419d204 service nova] Creating event network-changed:f08ebd88-3299-497a-a843-45bd052461ec for instance f4cfb681-1ffb-46ac-904f-0cbe1d44eaca on hv-cinder-84327 Jun 16 00:38:52.759509 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-d12fb4b9-9330-47ee-ac54-5c5ff00dfa40 req-11d37d52-c231-4acd-ab1a-ce97a419d204 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035993 Jun 16 00:38:52.760148 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 511/1043] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:38:53.446249 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-aa534fd3-2863-441c-9a71-0e865fe43261 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:53.446799 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-aa534fd3-2863-441c-9a71-0e865fe43261 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:53.453216 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aa534fd3-2863-441c-9a71-0e865fe43261 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:53.453658 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aa534fd3-2863-441c-9a71-0e865fe43261 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:53.454411 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aa534fd3-2863-441c-9a71-0e865fe43261 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:53.454839 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-aa534fd3-2863-441c-9a71-0e865fe43261 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:53.585221 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-aa534fd3-2863-441c-9a71-0e865fe43261 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:53.592693 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-aa534fd3-2863-441c-9a71-0e865fe43261 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1315 microversion: 2.1 time: 0.150440 Jun 16 00:38:53.593247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 533/1044] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:53 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:54.610474 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1d373a6d-0da2-4df0-814d-a5054d9f6019 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:54.611171 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1d373a6d-0da2-4df0-814d-a5054d9f6019 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:54.617895 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1d373a6d-0da2-4df0-814d-a5054d9f6019 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:54.618343 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1d373a6d-0da2-4df0-814d-a5054d9f6019 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:54.619112 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1d373a6d-0da2-4df0-814d-a5054d9f6019 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:54.619684 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1d373a6d-0da2-4df0-814d-a5054d9f6019 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:54.749189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1d373a6d-0da2-4df0-814d-a5054d9f6019 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:54.757095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1d373a6d-0da2-4df0-814d-a5054d9f6019 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1315 microversion: 2.1 time: 0.151251 Jun 16 00:38:54.757666 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 512/1045] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:54 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:55.773753 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-32ccccd2-6b2b-4e76-afc4-7fe23095da56 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:55.774508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-32ccccd2-6b2b-4e76-afc4-7fe23095da56 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:55.780989 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-32ccccd2-6b2b-4e76-afc4-7fe23095da56 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:55.781436 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-32ccccd2-6b2b-4e76-afc4-7fe23095da56 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:55.782199 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-32ccccd2-6b2b-4e76-afc4-7fe23095da56 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:55.782635 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-32ccccd2-6b2b-4e76-afc4-7fe23095da56 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:55.914762 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-32ccccd2-6b2b-4e76-afc4-7fe23095da56 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:55.922104 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-32ccccd2-6b2b-4e76-afc4-7fe23095da56 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1315 microversion: 2.1 time: 0.152832 Jun 16 00:38:55.922654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 534/1046] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:55 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:56.939259 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9db62526-eb82-4dc0-bde1-36c36b6d11b7 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:56.939889 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9db62526-eb82-4dc0-bde1-36c36b6d11b7 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:56.947083 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9db62526-eb82-4dc0-bde1-36c36b6d11b7 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:56.947531 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9db62526-eb82-4dc0-bde1-36c36b6d11b7 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:56.948333 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9db62526-eb82-4dc0-bde1-36c36b6d11b7 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:56.948811 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9db62526-eb82-4dc0-bde1-36c36b6d11b7 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:57.072692 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9db62526-eb82-4dc0-bde1-36c36b6d11b7 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:57.079973 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9db62526-eb82-4dc0-bde1-36c36b6d11b7 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1315 microversion: 2.1 time: 0.144568 Jun 16 00:38:57.080526 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 513/1047] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:56 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:58.096948 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-04782f87-e2c5-461a-9b5f-c21aa4eb83b6 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:58.098123 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-04782f87-e2c5-461a-9b5f-c21aa4eb83b6 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:58.104557 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-04782f87-e2c5-461a-9b5f-c21aa4eb83b6 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:58.105011 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-04782f87-e2c5-461a-9b5f-c21aa4eb83b6 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:58.105780 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-04782f87-e2c5-461a-9b5f-c21aa4eb83b6 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:58.106231 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-04782f87-e2c5-461a-9b5f-c21aa4eb83b6 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:58.234946 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-04782f87-e2c5-461a-9b5f-c21aa4eb83b6 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:58.242281 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-04782f87-e2c5-461a-9b5f-c21aa4eb83b6 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1315 microversion: 2.1 time: 0.149304 Jun 16 00:38:58.242838 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 535/1048] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:58 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:59.258726 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-de52a7e2-ff73-4962-9b33-f6455e1b17e0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:59.259337 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-de52a7e2-ff73-4962-9b33-f6455e1b17e0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:59.266123 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-de52a7e2-ff73-4962-9b33-f6455e1b17e0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:59.266576 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-de52a7e2-ff73-4962-9b33-f6455e1b17e0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:59.267337 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-de52a7e2-ff73-4962-9b33-f6455e1b17e0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:59.267797 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-de52a7e2-ff73-4962-9b33-f6455e1b17e0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:59.401117 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-de52a7e2-ff73-4962-9b33-f6455e1b17e0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:59.410477 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-de52a7e2-ff73-4962-9b33-f6455e1b17e0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1315 microversion: 2.1 time: 0.155500 Jun 16 00:38:59.411059 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 514/1049] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:59 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:59.507078 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-f2605899-8b7e-4009-b47f-164072c25c97 req-ad44b627-c356-4a00-85fb-c37f024ce40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cfb681-1ffb-46ac-904f-0cbe1d44eaca", "name": "network-vif-plugged", "status": "completed", "tag": "f08ebd88-3299-497a-a843-45bd052461ec"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:59.515214 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-f2605899-8b7e-4009-b47f-164072c25c97 req-ad44b627-c356-4a00-85fb-c37f024ce40d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:59.515672 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-f2605899-8b7e-4009-b47f-164072c25c97 req-ad44b627-c356-4a00-85fb-c37f024ce40d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:59.526630 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-f2605899-8b7e-4009-b47f-164072c25c97 req-ad44b627-c356-4a00-85fb-c37f024ce40d service nova] Creating event network-vif-plugged:f08ebd88-3299-497a-a843-45bd052461ec for instance f4cfb681-1ffb-46ac-904f-0cbe1d44eaca on hv-cinder-84327 Jun 16 00:38:59.531603 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-f2605899-8b7e-4009-b47f-164072c25c97 req-ad44b627-c356-4a00-85fb-c37f024ce40d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166824 Jun 16 00:38:59.532260 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 536/1050] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:39:00.428066 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5d2f96d3-de97-4666-9eda-4d60a6a0e993 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:00.428532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5d2f96d3-de97-4666-9eda-4d60a6a0e993 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:00.430315 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:00.431090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=6 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:00.437861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5d2f96d3-de97-4666-9eda-4d60a6a0e993 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:00.438315 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5d2f96d3-de97-4666-9eda-4d60a6a0e993 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:00.439088 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5d2f96d3-de97-4666-9eda-4d60a6a0e993 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:00.439518 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5d2f96d3-de97-4666-9eda-4d60a6a0e993 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:00.571857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5d2f96d3-de97-4666-9eda-4d60a6a0e993 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:00.579144 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5d2f96d3-de97-4666-9eda-4d60a6a0e993 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1315 microversion: 2.1 time: 0.155804 Jun 16 00:39:00.579720 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 515/1051] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:00 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:01.592718 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=6 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:01.597827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-130baefb-f849-4bbc-8644-deb92f8d0965 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:01.598524 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-130baefb-f849-4bbc-8644-deb92f8d0965 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:01.604960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-130baefb-f849-4bbc-8644-deb92f8d0965 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:01.605405 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-130baefb-f849-4bbc-8644-deb92f8d0965 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:01.606164 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-130baefb-f849-4bbc-8644-deb92f8d0965 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:01.606596 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-130baefb-f849-4bbc-8644-deb92f8d0965 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:01.734536 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-130baefb-f849-4bbc-8644-deb92f8d0965 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:01.742833 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-130baefb-f849-4bbc-8644-deb92f8d0965 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1315 microversion: 2.1 time: 0.151047 Jun 16 00:39:01.743407 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 537/1052] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:01 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:02.759458 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-03eb41c0-56f7-4dea-9b5b-5e90d791e81d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:02.760036 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-03eb41c0-56f7-4dea-9b5b-5e90d791e81d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:02.766761 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-03eb41c0-56f7-4dea-9b5b-5e90d791e81d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:02.767205 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-03eb41c0-56f7-4dea-9b5b-5e90d791e81d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:02.768001 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-03eb41c0-56f7-4dea-9b5b-5e90d791e81d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:02.768430 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-03eb41c0-56f7-4dea-9b5b-5e90d791e81d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:02.898945 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-03eb41c0-56f7-4dea-9b5b-5e90d791e81d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:02.906500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-03eb41c0-56f7-4dea-9b5b-5e90d791e81d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1465 microversion: 2.1 time: 0.151056 Jun 16 00:39:02.907066 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 516/1053] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:02 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1465 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:02.945662 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-05534d34-1dd8-4855-9fa3-9d59b9f54a5b tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:02.946175 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-05534d34-1dd8-4855-9fa3-9d59b9f54a5b tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:02.952271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-05534d34-1dd8-4855-9fa3-9d59b9f54a5b tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:02.952721 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-05534d34-1dd8-4855-9fa3-9d59b9f54a5b tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:02.953487 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-05534d34-1dd8-4855-9fa3-9d59b9f54a5b tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:02.953924 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-05534d34-1dd8-4855-9fa3-9d59b9f54a5b tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:02.978451 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-05534d34-1dd8-4855-9fa3-9d59b9f54a5b tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Going to try to terminate instance {{(pid=129466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:39:03.050660 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-05534d34-1dd8-4855-9fa3-9d59b9f54a5b tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 204 len: 0 microversion: 2.1 time: 0.107923 Jun 16 00:39:03.051165 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 538/1054] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:39:02 2022] DELETE /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:39:03.059735 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ac0882d0-38a6-4244-99d0-0a27ee0320f0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:03.060347 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ac0882d0-38a6-4244-99d0-0a27ee0320f0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:03.066362 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ac0882d0-38a6-4244-99d0-0a27ee0320f0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:03.066816 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ac0882d0-38a6-4244-99d0-0a27ee0320f0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:03.067581 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ac0882d0-38a6-4244-99d0-0a27ee0320f0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:03.068043 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ac0882d0-38a6-4244-99d0-0a27ee0320f0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:03.193577 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ac0882d0-38a6-4244-99d0-0a27ee0320f0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:03.200987 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ac0882d0-38a6-4244-99d0-0a27ee0320f0 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1471 microversion: 2.1 time: 0.145129 Jun 16 00:39:03.201551 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 517/1055] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:03 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:04.219962 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-6aae0b7a-d761-4c11-b970-7eaadec51b0d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:04.220650 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-6aae0b7a-d761-4c11-b970-7eaadec51b0d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:04.227838 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6aae0b7a-d761-4c11-b970-7eaadec51b0d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:04.228282 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6aae0b7a-d761-4c11-b970-7eaadec51b0d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:04.229056 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6aae0b7a-d761-4c11-b970-7eaadec51b0d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:04.229466 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-6aae0b7a-d761-4c11-b970-7eaadec51b0d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:04.360461 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-6aae0b7a-d761-4c11-b970-7eaadec51b0d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:04.368516 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-6aae0b7a-d761-4c11-b970-7eaadec51b0d tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1471 microversion: 2.1 time: 0.153306 Jun 16 00:39:04.369107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 539/1056] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:04 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:05.385731 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b13835e6-af0a-4093-8670-9ba0605c1335 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:05.386301 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b13835e6-af0a-4093-8670-9ba0605c1335 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:05.392856 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b13835e6-af0a-4093-8670-9ba0605c1335 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:05.393302 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b13835e6-af0a-4093-8670-9ba0605c1335 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:05.394756 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b13835e6-af0a-4093-8670-9ba0605c1335 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:05.395189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b13835e6-af0a-4093-8670-9ba0605c1335 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:05.479118 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b13835e6-af0a-4093-8670-9ba0605c1335 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eccc7e263340c98313f65496e89fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0fd6a893b43f3a62537f9abb82f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:05.487690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b13835e6-af0a-4093-8670-9ba0605c1335 tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 200 len: 1429 microversion: 2.1 time: 0.105665 Jun 16 00:39:05.488503 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 518/1057] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:05 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 1429 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:05.527063 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-bb86e75d-b1a0-4938-b027-703ce7ae7c30 req-ed75f481-e337-4edd-b36a-e2651ebe3b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cfb681-1ffb-46ac-904f-0cbe1d44eaca", "name": "network-vif-deleted", "tag": "f08ebd88-3299-497a-a843-45bd052461ec"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:05.535797 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-bb86e75d-b1a0-4938-b027-703ce7ae7c30 req-ed75f481-e337-4edd-b36a-e2651ebe3b9b service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:05.536244 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-bb86e75d-b1a0-4938-b027-703ce7ae7c30 req-ed75f481-e337-4edd-b36a-e2651ebe3b9b service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:05.548013 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-bb86e75d-b1a0-4938-b027-703ce7ae7c30 req-ed75f481-e337-4edd-b36a-e2651ebe3b9b service nova] Creating event network-vif-deleted:f08ebd88-3299-497a-a843-45bd052461ec for instance f4cfb681-1ffb-46ac-904f-0cbe1d44eaca on hv-cinder-84327 Jun 16 00:39:05.553262 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-bb86e75d-b1a0-4938-b027-703ce7ae7c30 req-ed75f481-e337-4edd-b36a-e2651ebe3b9b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029780 Jun 16 00:39:05.554156 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 540/1058] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:06.505190 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d57cf273-fa20-483c-bd6a-01284b51707a tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:06.505824 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d57cf273-fa20-483c-bd6a-01284b51707a tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] [instance: f4cfb681-1ffb-46ac-904f-0cbe1d44eaca] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:06.512252 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d57cf273-fa20-483c-bd6a-01284b51707a tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:06.512696 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d57cf273-fa20-483c-bd6a-01284b51707a tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:06.513447 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d57cf273-fa20-483c-bd6a-01284b51707a tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:06.513878 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d57cf273-fa20-483c-bd6a-01284b51707a tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:06.527036 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-d57cf273-fa20-483c-bd6a-01284b51707a tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] HTTP exception thrown: Instance f4cfb681-1ffb-46ac-904f-0cbe1d44eaca could not be found. Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d57cf273-fa20-483c-bd6a-01284b51707a tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Request method failure captured: Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca HTTP/1.1 Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnuXEH8JG3EsdMoEElEGPIEJJB2obG6gA-SAW8pCPyXe4xQx_hZW0NbbQkdg2CtKwT-atmmhYcpzuebRsK1Z49vsgfdwp0ZL3Dq6MgKiLzdfaDNY8fShLt2lbOBf4rLPeaCBPQEnwk63JArSr-P6Ee1-PK5dDfgIkuygEjjy5fVGKH0 Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 8bf0fd6a893b43f3a62537f9abb82f34 Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-VolumesNegativeTest-203053121 Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:39:06.528653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:39:06.530340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8bf0fd6a893b43f3a62537f9abb82f34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8bf0fd6a893b43f3a62537f9abb82f34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8bf0fd6a893b43f3a62537f9abb82f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8bf0fd6a893b43f3a62537f9abb82f34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:39:06.530340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-VolumesNegativeTest-203053121 Jun 16 00:39:06.530340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 8bf0fd6a893b43f3a62537f9abb82f34 Jun 16 00:39:06.530340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-VolumesNegativeTest-203053121 Jun 16 00:39:06.530340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-VolumesNegativeTest-203053121-project Jun 16 00:39:06.530340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:39:06.530340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:39:06.530340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: 59eccc7e263340c98313f65496e89fe3 Jun 16 00:39:06.530340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-VolumesNegativeTest-203053121-project Jun 16 00:39:06.530340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:39:06.530340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance f4cfb681-1ffb-46ac-904f-0cbe1d44eaca could not be found. Jun 16 00:39:06.530340 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': 'f4cfb681-1ffb-46ac-904f-0cbe1d44eaca'} Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4cfb681-1ffb-46ac-904f-0cbe1d44eaca could not be found. Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:39:06.531500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4cfb681-1ffb-46ac-904f-0cbe1d44eaca could not be found. Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4cfb681-1ffb-46ac-904f-0cbe1d44eaca could not be found. Jun 16 00:39:06.533122 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:39:06.534537 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d57cf273-fa20-483c-bd6a-01284b51707a tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] Returning 404 to user: Instance f4cfb681-1ffb-46ac-904f-0cbe1d44eaca could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:39:06.534537 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d57cf273-fa20-483c-bd6a-01284b51707a tempest-VolumesNegativeTest-203053121 tempest-VolumesNegativeTest-203053121-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca" status: 404 len: 111 microversion: 2.1 time: 0.029279 Jun 16 00:39:06.534537 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 519/1059] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:06 2022] GET /compute/v2.1/servers/f4cfb681-1ffb-46ac-904f-0cbe1d44eaca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:39:07.950814 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-809911172", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1794881766", "security_groups": [{"name": "tempest-secgroup-smoke-596553076"}], "block_device_mapping_v2": [{"uuid": "6c4e892e-14a4-4e5d-9eb8-eec031097966", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c76d405a-2e1d-4834-ac04-fe5df400b255"}]}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:08.076396 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.network.neutron [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] validate_networks() for [('c76d405a-2e1d-4834-ac04-fe5df400b255', None, None, None, None, None)] {{(pid=129466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:39:08.560030 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Flavor limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:39:08.560460 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Image limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:39:08.561163 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Flavor pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:39:08.561605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Image pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:39:08.562017 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:39:08.573367 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:08.573821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:08.574623 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:08.575066 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:08.592811 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Getting quotas for project e0d870e67f68470988dd26ac7aef3fec. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:39:08.596837 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Getting quotas for user c9f93af4621b4a9db098c299c9e32c20 and project e0d870e67f68470988dd26ac7aef3fec. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:39:08.654271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Going to run 1 instances... {{(pid=129466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:39:08.656478 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c4e892e-14a4-4e5d-9eb8-eec031097966',volume_size=None,volume_type=None)] {{(pid=129466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:39:08.792819 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-50b0d6d2-52cc-4d0a-8a45-4bd70b220d59 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.846624 Jun 16 00:39:08.793335 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 541/1060] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:39:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:39:08.804118 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-68b632e3-5aa4-4e24-a4c5-7343d9c05b3e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:08.805406 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-68b632e3-5aa4-4e24-a4c5-7343d9c05b3e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:08.875329 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-68b632e3-5aa4-4e24-a4c5-7343d9c05b3e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:08.892916 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-68b632e3-5aa4-4e24-a4c5-7343d9c05b3e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1094 microversion: 2.1 time: 0.093395 Jun 16 00:39:08.894144 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 520/1061] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:08 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:09.911198 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0adca60a-4f89-44da-bc43-c1ec4b0d3c05 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:09.911962 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0adca60a-4f89-44da-bc43-c1ec4b0d3c05 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:09.919540 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0adca60a-4f89-44da-bc43-c1ec4b0d3c05 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.920024 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0adca60a-4f89-44da-bc43-c1ec4b0d3c05 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.920799 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0adca60a-4f89-44da-bc43-c1ec4b0d3c05 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.921237 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0adca60a-4f89-44da-bc43-c1ec4b0d3c05 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.999128 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-0adca60a-4f89-44da-bc43-c1ec4b0d3c05 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:10.006892 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0adca60a-4f89-44da-bc43-c1ec4b0d3c05 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1210 microversion: 2.1 time: 0.100109 Jun 16 00:39:10.007454 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 542/1062] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:09 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:11.025394 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-e86f2cd6-c59c-4d10-b9c0-bfd962b292d7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:11.026252 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-e86f2cd6-c59c-4d10-b9c0-bfd962b292d7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:11.035641 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e86f2cd6-c59c-4d10-b9c0-bfd962b292d7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:11.036442 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e86f2cd6-c59c-4d10-b9c0-bfd962b292d7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:11.037307 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e86f2cd6-c59c-4d10-b9c0-bfd962b292d7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:11.037858 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-e86f2cd6-c59c-4d10-b9c0-bfd962b292d7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:11.440332 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-e86f2cd6-c59c-4d10-b9c0-bfd962b292d7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:11.448095 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-e86f2cd6-c59c-4d10-b9c0-bfd962b292d7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1265 microversion: 2.1 time: 0.426809 Jun 16 00:39:11.457818 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 521/1063] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:11 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1265 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:11.607804 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-3fc482ee-1869-4169-8c9a-6ab28ed8c046 req-50cbe937-7431-4a63-a029-b70d4ccc323e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4813890-4093-4866-b4c6-fbbbed962872", "tag": "74cc5c9c-50cf-4243-b8a8-e4f4dbaa8d86"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:11.619758 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-3fc482ee-1869-4169-8c9a-6ab28ed8c046 req-50cbe937-7431-4a63-a029-b70d4ccc323e service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:11.620430 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-3fc482ee-1869-4169-8c9a-6ab28ed8c046 req-50cbe937-7431-4a63-a029-b70d4ccc323e service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:11.634736 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-3fc482ee-1869-4169-8c9a-6ab28ed8c046 req-50cbe937-7431-4a63-a029-b70d4ccc323e service nova] Creating event network-changed:74cc5c9c-50cf-4243-b8a8-e4f4dbaa8d86 for instance d4813890-4093-4866-b4c6-fbbbed962872 on hv-cinder-84327 Jun 16 00:39:11.640488 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-3fc482ee-1869-4169-8c9a-6ab28ed8c046 req-50cbe937-7431-4a63-a029-b70d4ccc323e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037139 Jun 16 00:39:11.642212 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 543/1064] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:39:12.465067 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-95728735-4abc-40f4-be2c-a9fe6b5e1ac5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:12.465672 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-95728735-4abc-40f4-be2c-a9fe6b5e1ac5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:12.472723 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-95728735-4abc-40f4-be2c-a9fe6b5e1ac5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:12.473168 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-95728735-4abc-40f4-be2c-a9fe6b5e1ac5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:12.473920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-95728735-4abc-40f4-be2c-a9fe6b5e1ac5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:12.474352 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-95728735-4abc-40f4-be2c-a9fe6b5e1ac5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:12.601731 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-95728735-4abc-40f4-be2c-a9fe6b5e1ac5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:12.609132 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-95728735-4abc-40f4-be2c-a9fe6b5e1ac5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1265 microversion: 2.1 time: 0.147856 Jun 16 00:39:12.609679 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 522/1065] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:12 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:13.627312 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5ce6b6e0-f390-4b67-a563-85883b800b13 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:13.628459 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5ce6b6e0-f390-4b67-a563-85883b800b13 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:13.630402 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:13.636676 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5ce6b6e0-f390-4b67-a563-85883b800b13 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:13.637140 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5ce6b6e0-f390-4b67-a563-85883b800b13 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:13.637911 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5ce6b6e0-f390-4b67-a563-85883b800b13 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:13.638385 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5ce6b6e0-f390-4b67-a563-85883b800b13 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:13.643743 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:13.775741 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5ce6b6e0-f390-4b67-a563-85883b800b13 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:13.783180 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5ce6b6e0-f390-4b67-a563-85883b800b13 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1265 microversion: 2.1 time: 0.160651 Jun 16 00:39:13.783762 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 544/1066] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:13 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:14.799782 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-92756c7f-6560-435e-b29e-c5c45510eb79 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:14.800390 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-92756c7f-6560-435e-b29e-c5c45510eb79 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:14.806796 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-92756c7f-6560-435e-b29e-c5c45510eb79 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:14.807242 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-92756c7f-6560-435e-b29e-c5c45510eb79 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:14.808036 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-92756c7f-6560-435e-b29e-c5c45510eb79 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:14.808476 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-92756c7f-6560-435e-b29e-c5c45510eb79 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:14.937772 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-92756c7f-6560-435e-b29e-c5c45510eb79 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:14.945626 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-92756c7f-6560-435e-b29e-c5c45510eb79 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1265 microversion: 2.1 time: 0.149781 Jun 16 00:39:14.946189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 523/1067] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:14 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:15.962391 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a8216b86-8aae-4307-9265-66762223a03f tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:15.963001 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a8216b86-8aae-4307-9265-66762223a03f tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:15.969486 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a8216b86-8aae-4307-9265-66762223a03f tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:15.969934 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a8216b86-8aae-4307-9265-66762223a03f tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:15.970700 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a8216b86-8aae-4307-9265-66762223a03f tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:15.971654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a8216b86-8aae-4307-9265-66762223a03f tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:16.099567 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a8216b86-8aae-4307-9265-66762223a03f tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:16.107180 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a8216b86-8aae-4307-9265-66762223a03f tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1265 microversion: 2.1 time: 0.148834 Jun 16 00:39:16.107754 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 545/1068] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:15 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:17.124482 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c80db3f1-385e-43bb-9bf1-2a8807dcb5af tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:17.125124 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c80db3f1-385e-43bb-9bf1-2a8807dcb5af tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:17.131365 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c80db3f1-385e-43bb-9bf1-2a8807dcb5af tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:17.131836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c80db3f1-385e-43bb-9bf1-2a8807dcb5af tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:17.132592 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c80db3f1-385e-43bb-9bf1-2a8807dcb5af tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:17.133019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c80db3f1-385e-43bb-9bf1-2a8807dcb5af tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:17.265534 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c80db3f1-385e-43bb-9bf1-2a8807dcb5af tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:17.273473 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c80db3f1-385e-43bb-9bf1-2a8807dcb5af tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1265 microversion: 2.1 time: 0.152893 Jun 16 00:39:17.274033 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 524/1069] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:17 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:18.290404 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-777e9f54-c049-413f-be9f-84be109d96ea tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:18.291017 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-777e9f54-c049-413f-be9f-84be109d96ea tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:18.297498 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-777e9f54-c049-413f-be9f-84be109d96ea tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:18.297952 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-777e9f54-c049-413f-be9f-84be109d96ea tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:18.298716 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-777e9f54-c049-413f-be9f-84be109d96ea tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:18.299799 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-777e9f54-c049-413f-be9f-84be109d96ea tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:18.429298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-777e9f54-c049-413f-be9f-84be109d96ea tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:18.436859 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-777e9f54-c049-413f-be9f-84be109d96ea tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1265 microversion: 2.1 time: 0.150311 Jun 16 00:39:18.437410 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 546/1070] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:18 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:19.453503 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-58926e72-937a-4f3c-8296-55e4eb5a4d74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:19.454108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-58926e72-937a-4f3c-8296-55e4eb5a4d74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:19.457025 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:19.457663 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:19.462937 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-58926e72-937a-4f3c-8296-55e4eb5a4d74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:19.463376 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-58926e72-937a-4f3c-8296-55e4eb5a4d74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:19.464157 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-58926e72-937a-4f3c-8296-55e4eb5a4d74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:19.464586 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-58926e72-937a-4f3c-8296-55e4eb5a4d74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:19.467826 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=79 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:19.597976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-58926e72-937a-4f3c-8296-55e4eb5a4d74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:19.605500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-58926e72-937a-4f3c-8296-55e4eb5a4d74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1265 microversion: 2.1 time: 0.155810 Jun 16 00:39:19.605999 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 525/1071] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:19 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:20.621899 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-dfc3df8a-cb79-4160-ac1d-aa3dd91178ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:20.622508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-dfc3df8a-cb79-4160-ac1d-aa3dd91178ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:20.624354 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:20.625019 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=6 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:20.631756 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-dfc3df8a-cb79-4160-ac1d-aa3dd91178ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:20.632210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-dfc3df8a-cb79-4160-ac1d-aa3dd91178ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:20.632979 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-dfc3df8a-cb79-4160-ac1d-aa3dd91178ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:20.633414 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-dfc3df8a-cb79-4160-ac1d-aa3dd91178ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:20.652185 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-fe1cb7f2-f396-4e74-a9ec-b37e049b4906 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:20.653113 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-fe1cb7f2-f396-4e74-a9ec-b37e049b4906 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:20.660157 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fe1cb7f2-f396-4e74-a9ec-b37e049b4906 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:20.660620 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fe1cb7f2-f396-4e74-a9ec-b37e049b4906 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:20.661388 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fe1cb7f2-f396-4e74-a9ec-b37e049b4906 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:20.661857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fe1cb7f2-f396-4e74-a9ec-b37e049b4906 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:20.690385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-fe1cb7f2-f396-4e74-a9ec-b37e049b4906 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042127 Jun 16 00:39:20.690939 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 526/1072] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:39:20 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 00:39:20.749185 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6caf1f69-0f1b-4d1f-9f3d-27d6cae4b00f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:20.749682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6caf1f69-0f1b-4d1f-9f3d-27d6cae4b00f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:20.755696 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6caf1f69-0f1b-4d1f-9f3d-27d6cae4b00f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:20.756138 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6caf1f69-0f1b-4d1f-9f3d-27d6cae4b00f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:20.756890 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6caf1f69-0f1b-4d1f-9f3d-27d6cae4b00f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:20.757314 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6caf1f69-0f1b-4d1f-9f3d-27d6cae4b00f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:20.765953 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-dfc3df8a-cb79-4160-ac1d-aa3dd91178ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:20.774046 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-dfc3df8a-cb79-4160-ac1d-aa3dd91178ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1265 microversion: 2.1 time: 0.155841 Jun 16 00:39:20.774606 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 547/1073] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:20 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:20.783548 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6caf1f69-0f1b-4d1f-9f3d-27d6cae4b00f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Going to try to terminate instance {{(pid=129465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:39:20.857555 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6caf1f69-0f1b-4d1f-9f3d-27d6cae4b00f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 204 len: 0 microversion: 2.1 time: 0.113060 Jun 16 00:39:20.858169 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 527/1074] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:39:20 2022] DELETE /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 00:39:20.867500 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c9ea5e88-f339-48ed-a974-a725c06fe43f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:20.868144 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c9ea5e88-f339-48ed-a974-a725c06fe43f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:20.874457 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c9ea5e88-f339-48ed-a974-a725c06fe43f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:20.874959 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c9ea5e88-f339-48ed-a974-a725c06fe43f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:20.875834 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c9ea5e88-f339-48ed-a974-a725c06fe43f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:20.876274 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c9ea5e88-f339-48ed-a974-a725c06fe43f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:21.006499 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c9ea5e88-f339-48ed-a974-a725c06fe43f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:21.013968 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c9ea5e88-f339-48ed-a974-a725c06fe43f tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1672 microversion: 2.1 time: 0.150556 Jun 16 00:39:21.014787 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 548/1075] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:20 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:21.413783 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-1c0f7aa6-b045-4588-8d80-a5aff9bd886a req-48145a2a-fc06-4cbb-8121-b9ec4498b97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4813890-4093-4866-b4c6-fbbbed962872", "name": "network-vif-plugged", "status": "completed", "tag": "74cc5c9c-50cf-4243-b8a8-e4f4dbaa8d86"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:21.423554 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-1c0f7aa6-b045-4588-8d80-a5aff9bd886a req-48145a2a-fc06-4cbb-8121-b9ec4498b97d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:21.424416 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-1c0f7aa6-b045-4588-8d80-a5aff9bd886a req-48145a2a-fc06-4cbb-8121-b9ec4498b97d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:21.436085 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-1c0f7aa6-b045-4588-8d80-a5aff9bd886a req-48145a2a-fc06-4cbb-8121-b9ec4498b97d service nova] Creating event network-vif-plugged:74cc5c9c-50cf-4243-b8a8-e4f4dbaa8d86 for instance d4813890-4093-4866-b4c6-fbbbed962872 on hv-cinder-84327 Jun 16 00:39:21.441694 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-1c0f7aa6-b045-4588-8d80-a5aff9bd886a req-48145a2a-fc06-4cbb-8121-b9ec4498b97d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032202 Jun 16 00:39:21.442474 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 528/1076] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:21.790544 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2827d717-5ccc-4c16-8bdb-87006ba5ff74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:21.791187 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2827d717-5ccc-4c16-8bdb-87006ba5ff74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:21.798083 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2827d717-5ccc-4c16-8bdb-87006ba5ff74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:21.798438 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2827d717-5ccc-4c16-8bdb-87006ba5ff74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:21.799543 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2827d717-5ccc-4c16-8bdb-87006ba5ff74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:21.800259 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2827d717-5ccc-4c16-8bdb-87006ba5ff74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:21.930672 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2827d717-5ccc-4c16-8bdb-87006ba5ff74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:21.938064 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2827d717-5ccc-4c16-8bdb-87006ba5ff74 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1265 microversion: 2.1 time: 0.151531 Jun 16 00:39:21.939210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 549/1077] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:21 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:22.031824 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9542e07c-3970-4bd0-9014-a104bbfe176a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:22.032514 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9542e07c-3970-4bd0-9014-a104bbfe176a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:22.038716 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9542e07c-3970-4bd0-9014-a104bbfe176a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:22.039161 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9542e07c-3970-4bd0-9014-a104bbfe176a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:22.039967 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9542e07c-3970-4bd0-9014-a104bbfe176a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:22.040397 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9542e07c-3970-4bd0-9014-a104bbfe176a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:22.177524 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-9542e07c-3970-4bd0-9014-a104bbfe176a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:22.185337 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9542e07c-3970-4bd0-9014-a104bbfe176a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1672 microversion: 2.1 time: 0.157680 Jun 16 00:39:22.186116 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 529/1078] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:22 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:22.957657 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fdd73000-eb6f-4d63-bec3-b103873a3018 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:22.958454 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fdd73000-eb6f-4d63-bec3-b103873a3018 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:22.965584 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fdd73000-eb6f-4d63-bec3-b103873a3018 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:22.966042 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fdd73000-eb6f-4d63-bec3-b103873a3018 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:22.966816 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fdd73000-eb6f-4d63-bec3-b103873a3018 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:22.967255 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fdd73000-eb6f-4d63-bec3-b103873a3018 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:23.106364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fdd73000-eb6f-4d63-bec3-b103873a3018 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:23.114810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fdd73000-eb6f-4d63-bec3-b103873a3018 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1265 microversion: 2.1 time: 0.162023 Jun 16 00:39:23.115398 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 550/1079] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:22 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:23.203318 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ca4ad999-67f9-4eb4-a7d1-65896f038d97 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:23.203944 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ca4ad999-67f9-4eb4-a7d1-65896f038d97 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:23.210817 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca4ad999-67f9-4eb4-a7d1-65896f038d97 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:23.211342 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca4ad999-67f9-4eb4-a7d1-65896f038d97 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:23.212203 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca4ad999-67f9-4eb4-a7d1-65896f038d97 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:23.212644 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ca4ad999-67f9-4eb4-a7d1-65896f038d97 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:23.277897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ca4ad999-67f9-4eb4-a7d1-65896f038d97 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:23.286365 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ca4ad999-67f9-4eb4-a7d1-65896f038d97 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1604 microversion: 2.1 time: 0.086915 Jun 16 00:39:23.286953 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 530/1080] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:23 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1604 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:23.593207 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-6907cbe1-da48-4325-bd73-93ca3b9cef62 req-2fbfa355-0397-4c4f-93de-6a93b66a124c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f39b67-fe8c-4a0a-8ac8-ca589391af83", "name": "network-vif-deleted", "tag": "2a8ee73b-38ca-40d3-b4f0-c1b095af5c9e"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:23.601609 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-6907cbe1-da48-4325-bd73-93ca3b9cef62 req-2fbfa355-0397-4c4f-93de-6a93b66a124c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:23.602049 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-6907cbe1-da48-4325-bd73-93ca3b9cef62 req-2fbfa355-0397-4c4f-93de-6a93b66a124c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:23.612787 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-6907cbe1-da48-4325-bd73-93ca3b9cef62 req-2fbfa355-0397-4c4f-93de-6a93b66a124c service nova] Creating event network-vif-deleted:2a8ee73b-38ca-40d3-b4f0-c1b095af5c9e for instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 on hv-cinder-84327 Jun 16 00:39:23.618060 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-6907cbe1-da48-4325-bd73-93ca3b9cef62 req-2fbfa355-0397-4c4f-93de-6a93b66a124c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157071 Jun 16 00:39:23.618925 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 551/1081] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:24.132099 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-904e398f-45f5-4eba-bb3e-2c8cc698287e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:24.132720 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-904e398f-45f5-4eba-bb3e-2c8cc698287e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:24.138659 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-904e398f-45f5-4eba-bb3e-2c8cc698287e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:24.139381 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-904e398f-45f5-4eba-bb3e-2c8cc698287e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:24.140177 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-904e398f-45f5-4eba-bb3e-2c8cc698287e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:24.140618 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-904e398f-45f5-4eba-bb3e-2c8cc698287e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:24.287005 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-904e398f-45f5-4eba-bb3e-2c8cc698287e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:24.296473 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-904e398f-45f5-4eba-bb3e-2c8cc698287e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1452 microversion: 2.1 time: 0.168165 Jun 16 00:39:24.297068 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 531/1082] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:24 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:24.304905 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fa6de73d-3829-45b5-b44b-92036ec0895a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:24.305595 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fa6de73d-3829-45b5-b44b-92036ec0895a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:24.312921 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-faa8cf95-4224-49c3-9945-5d2e316edd48 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:24.313532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-faa8cf95-4224-49c3-9945-5d2e316edd48 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:24.320047 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fa6de73d-3829-45b5-b44b-92036ec0895a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:24.320495 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-faa8cf95-4224-49c3-9945-5d2e316edd48 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:24.320611 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fa6de73d-3829-45b5-b44b-92036ec0895a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:24.321033 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-faa8cf95-4224-49c3-9945-5d2e316edd48 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:24.321268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fa6de73d-3829-45b5-b44b-92036ec0895a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:24.321699 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fa6de73d-3829-45b5-b44b-92036ec0895a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:24.322088 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-faa8cf95-4224-49c3-9945-5d2e316edd48 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:24.322608 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-faa8cf95-4224-49c3-9945-5d2e316edd48 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:24.353597 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fa6de73d-3829-45b5-b44b-92036ec0895a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:24.354040 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fa6de73d-3829-45b5-b44b-92036ec0895a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:24.354544 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.objects.instance [None req-fa6de73d-3829-45b5-b44b-92036ec0895a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lazy-loading 'fault' on Instance uuid b3f39b67-fe8c-4a0a-8ac8-ca589391af83 {{(pid=129466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:39:24.418254 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fa6de73d-3829-45b5-b44b-92036ec0895a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:24.427275 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fa6de73d-3829-45b5-b44b-92036ec0895a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 200 len: 1326 microversion: 2.1 time: 0.127456 Jun 16 00:39:24.428151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 552/1083] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:24 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 1326 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:24.487437 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-faa8cf95-4224-49c3-9945-5d2e316edd48 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:24.494964 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-faa8cf95-4224-49c3-9945-5d2e316edd48 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1452 microversion: 2.1 time: 0.185815 Jun 16 00:39:24.495653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 532/1084] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:24 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:25.445176 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ba063d84-f901-48d7-a479-76e1f7e0f451 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:25.445776 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ba063d84-f901-48d7-a479-76e1f7e0f451 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:25.452253 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ba063d84-f901-48d7-a479-76e1f7e0f451 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:25.452701 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ba063d84-f901-48d7-a479-76e1f7e0f451 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:25.453472 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ba063d84-f901-48d7-a479-76e1f7e0f451 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:25.453909 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ba063d84-f901-48d7-a479-76e1f7e0f451 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:25.467938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-ba063d84-f901-48d7-a479-76e1f7e0f451 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] HTTP exception thrown: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ba063d84-f901-48d7-a479-76e1f7e0f451 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Request method failure captured: Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 HTTP/1.1 Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnpvG51OdQg8qboD6ehSgdV57fAY_VA9mqk8ViJmWrOzGcpoZjqh_k0fYXjrRuZ3dH9R8Yiahzyb7zEJXHvKOfbrdzRhX9n_o1em3FJLTzk9xeapxJPF5RMWLV3xF9Hu3azBiNAdiMqoF2daIgL6w6UEqNvOp-FaFkILhH5soDX9iSs Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 985ab6e44f6d4425a2def9b3a52262d8 Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:39:25.469582 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:39:25.471285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:39:25.471285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:39:25.471285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 985ab6e44f6d4425a2def9b3a52262d8 Jun 16 00:39:25.471285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:39:25.471285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-AttachVolumeTestJSON-597140553-project Jun 16 00:39:25.471285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:39:25.471285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:39:25.471285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: 9e3855abd7ea410fa64d546b3a85ff31 Jun 16 00:39:25.471285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-AttachVolumeTestJSON-597140553-project Jun 16 00:39:25.471285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:39:25.471285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:39:25.471285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': 'b3f39b67-fe8c-4a0a-8ac8-ca589391af83'} Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:39:25.472191 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:39:25.473503 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:39:25.474626 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ba063d84-f901-48d7-a479-76e1f7e0f451 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Returning 404 to user: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:39:25.474626 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ba063d84-f901-48d7-a479-76e1f7e0f451 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 404 len: 111 microversion: 2.1 time: 0.030265 Jun 16 00:39:25.474626 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 553/1085] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:25 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:39:25.480339 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1267b3b6-0369-4272-98b4-c35a60055717 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '.version_select at 0x7f95804ba1f0>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:25.503197 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1267b3b6-0369-4272-98b4-c35a60055717 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-331333114" status: 202 len: 0 microversion: 2.1 time: 0.026546 Jun 16 00:39:25.504499 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 533/1086] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jun 16 00:39:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-331333114 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:39:26.131508 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-db79e143-8497-4ca9-ab81-73786595c18b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Action: 'create', calling method: .version_select at 0x7f9573dd7310>, body: {"keypair": {"name": "tempest-keypair-180255684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRvMcnbH1ZlXOlGUC52hcDiLRYqz4qDEc2oCH1vt8GO90hPcoKrI3ihUKGZYRpH5441AE//4Aiem103GLKsvGKROSdnF/rZGOuctA/Rto3MciLM0CYK70pw3CxOIbMcyA=="}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:26.145928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-db79e143-8497-4ca9-ab81-73786595c18b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Getting quotas for project 985ab6e44f6d4425a2def9b3a52262d8. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:39:26.149795 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-db79e143-8497-4ca9-ab81-73786595c18b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Getting quotas for user 9e3855abd7ea410fa64d546b3a85ff31 and project 985ab6e44f6d4425a2def9b3a52262d8. Resources: {'key_pairs'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:39:26.173568 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-db79e143-8497-4ca9-ab81-73786595c18b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046303 Jun 16 00:39:26.174231 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 554/1087] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jun 16 00:39:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:26.225447 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-76acd5bc-ed72-4ecc-8bd5-fc7b21e5e0b0 req-2427ee19-22e2-4dbc-847f-1c9d5963ef4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4813890-4093-4866-b4c6-fbbbed962872", "tag": "74cc5c9c-50cf-4243-b8a8-e4f4dbaa8d86"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:26.235151 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-76acd5bc-ed72-4ecc-8bd5-fc7b21e5e0b0 req-2427ee19-22e2-4dbc-847f-1c9d5963ef4a service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:26.235946 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-76acd5bc-ed72-4ecc-8bd5-fc7b21e5e0b0 req-2427ee19-22e2-4dbc-847f-1c9d5963ef4a service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:26.247892 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-76acd5bc-ed72-4ecc-8bd5-fc7b21e5e0b0 req-2427ee19-22e2-4dbc-847f-1c9d5963ef4a service nova] Creating event network-changed:74cc5c9c-50cf-4243-b8a8-e4f4dbaa8d86 for instance d4813890-4093-4866-b4c6-fbbbed962872 on hv-cinder-84327 Jun 16 00:39:26.253498 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-76acd5bc-ed72-4ecc-8bd5-fc7b21e5e0b0 req-2427ee19-22e2-4dbc-847f-1c9d5963ef4a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032219 Jun 16 00:39:26.255282 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 534/1088] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:27.496737 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-645725913", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "059c3639-6ef4-446d-b198-5b0d90caf651"}], "security_groups": [{"name": "tempest-securitygroup--1294890994"}], "key_name": "tempest-keypair-180255684", "user_data": "}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:27.602104 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.network.neutron [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] validate_networks() for [('059c3639-6ef4-446d-b198-5b0d90caf651', None, None, None, None, None)] {{(pid=129466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:39:27.964506 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Flavor limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:39:27.964927 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Image limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:39:27.965396 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Flavor pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:39:27.965805 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Image pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:39:27.966211 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:39:27.975444 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:27.975926 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:27.976722 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:27.977154 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:27.993504 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Getting quotas for project 985ab6e44f6d4425a2def9b3a52262d8. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:39:27.997372 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Getting quotas for user 9e3855abd7ea410fa64d546b3a85ff31 and project 985ab6e44f6d4425a2def9b3a52262d8. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:39:28.007973 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Going to run 1 instances... {{(pid=129466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:39:28.016066 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:39:28.064304 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e2bd8ee9-a33f-4efd-a034-66576f854251 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.571795 Jun 16 00:39:28.065141 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 555/1089] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:39:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:39:28.076223 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2354de5f-8f2b-49ca-a72b-78e4b69e9b5a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:28.076924 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2354de5f-8f2b-49ca-a72b-78e4b69e9b5a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:28.142861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2354de5f-8f2b-49ca-a72b-78e4b69e9b5a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:28.151334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2354de5f-8f2b-49ca-a72b-78e4b69e9b5a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1236 microversion: 2.1 time: 0.079786 Jun 16 00:39:28.151936 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 535/1090] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:28 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:29.169447 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c86eae6c-943f-4939-9aec-e877da0436ae tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:29.170059 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c86eae6c-943f-4939-9aec-e877da0436ae tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:29.176695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c86eae6c-943f-4939-9aec-e877da0436ae tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:29.177139 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c86eae6c-943f-4939-9aec-e877da0436ae tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:29.178108 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c86eae6c-943f-4939-9aec-e877da0436ae tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:29.178540 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c86eae6c-943f-4939-9aec-e877da0436ae tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:29.240553 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c86eae6c-943f-4939-9aec-e877da0436ae tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:29.247828 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c86eae6c-943f-4939-9aec-e877da0436ae tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1294 microversion: 2.1 time: 0.082698 Jun 16 00:39:29.248379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 556/1091] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:29 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:30.264735 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4b86ede3-1923-42d1-bd5d-e71c42cf0e5d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:30.265354 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4b86ede3-1923-42d1-bd5d-e71c42cf0e5d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:30.274190 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4b86ede3-1923-42d1-bd5d-e71c42cf0e5d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:30.274683 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4b86ede3-1923-42d1-bd5d-e71c42cf0e5d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:30.275750 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4b86ede3-1923-42d1-bd5d-e71c42cf0e5d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:30.276195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4b86ede3-1923-42d1-bd5d-e71c42cf0e5d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:30.416388 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-4b86ede3-1923-42d1-bd5d-e71c42cf0e5d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:30.424806 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4b86ede3-1923-42d1-bd5d-e71c42cf0e5d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1362 microversion: 2.1 time: 0.164813 Jun 16 00:39:30.426395 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 536/1092] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:30 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:30.471468 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-65682391-9d5d-424e-ba02-eb98d7370399 req-b69c43ba-6102-40f9-8920-08d1e6c9b05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bae4bfa-4af9-47f6-8171-77b606dc88f8", "tag": "6ba8813c-0495-42cc-9993-20b407a12050"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:30.489659 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-65682391-9d5d-424e-ba02-eb98d7370399 req-b69c43ba-6102-40f9-8920-08d1e6c9b05e service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:30.490108 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-65682391-9d5d-424e-ba02-eb98d7370399 req-b69c43ba-6102-40f9-8920-08d1e6c9b05e service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:30.501799 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-65682391-9d5d-424e-ba02-eb98d7370399 req-b69c43ba-6102-40f9-8920-08d1e6c9b05e service nova] Creating event network-changed:6ba8813c-0495-42cc-9993-20b407a12050 for instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 on hv-cinder-84327 Jun 16 00:39:30.507207 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-65682391-9d5d-424e-ba02-eb98d7370399 req-b69c43ba-6102-40f9-8920-08d1e6c9b05e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047434 Jun 16 00:39:30.508157 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 557/1093] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:31.442744 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-99116036-362f-4998-bec6-567391dc6ca6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:31.443274 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-99116036-362f-4998-bec6-567391dc6ca6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:31.449898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99116036-362f-4998-bec6-567391dc6ca6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:31.450346 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99116036-362f-4998-bec6-567391dc6ca6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:31.451106 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99116036-362f-4998-bec6-567391dc6ca6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:31.451545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-99116036-362f-4998-bec6-567391dc6ca6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:31.578142 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-99116036-362f-4998-bec6-567391dc6ca6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:31.585472 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-99116036-362f-4998-bec6-567391dc6ca6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1362 microversion: 2.1 time: 0.146770 Jun 16 00:39:31.586033 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 537/1094] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:31 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:32.604107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-14551d43-57ec-486d-872f-7805f97a7702 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:32.604804 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-14551d43-57ec-486d-872f-7805f97a7702 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:32.610959 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-14551d43-57ec-486d-872f-7805f97a7702 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:32.611409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-14551d43-57ec-486d-872f-7805f97a7702 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:32.612197 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-14551d43-57ec-486d-872f-7805f97a7702 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:32.612636 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-14551d43-57ec-486d-872f-7805f97a7702 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:32.738294 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-14551d43-57ec-486d-872f-7805f97a7702 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:32.745707 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-14551d43-57ec-486d-872f-7805f97a7702 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1362 microversion: 2.1 time: 0.146685 Jun 16 00:39:32.746266 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 558/1095] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:32 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:33.762189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ad728749-87f2-4e04-8911-6a299ddca8d2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:33.762824 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ad728749-87f2-4e04-8911-6a299ddca8d2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:33.769626 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ad728749-87f2-4e04-8911-6a299ddca8d2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:33.770077 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ad728749-87f2-4e04-8911-6a299ddca8d2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:33.770866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ad728749-87f2-4e04-8911-6a299ddca8d2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:33.771303 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ad728749-87f2-4e04-8911-6a299ddca8d2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:33.897132 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ad728749-87f2-4e04-8911-6a299ddca8d2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:33.904643 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ad728749-87f2-4e04-8911-6a299ddca8d2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1362 microversion: 2.1 time: 0.146294 Jun 16 00:39:33.905225 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 538/1096] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:33 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:34.921597 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4be72d13-f854-40bb-b38b-04824919bf4a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:34.922140 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4be72d13-f854-40bb-b38b-04824919bf4a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:34.928630 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4be72d13-f854-40bb-b38b-04824919bf4a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:34.929078 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4be72d13-f854-40bb-b38b-04824919bf4a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:34.929836 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4be72d13-f854-40bb-b38b-04824919bf4a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:34.930271 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4be72d13-f854-40bb-b38b-04824919bf4a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:35.060116 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4be72d13-f854-40bb-b38b-04824919bf4a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:35.067491 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4be72d13-f854-40bb-b38b-04824919bf4a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1362 microversion: 2.1 time: 0.149949 Jun 16 00:39:35.068086 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 559/1097] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:34 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:35.584522 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-978c1de1-f670-454d-ac72-ce48dc35f12a req-cac8a1eb-d005-4fdc-8248-7fa926a967c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bae4bfa-4af9-47f6-8171-77b606dc88f8", "name": "network-vif-plugged", "status": "completed", "tag": "6ba8813c-0495-42cc-9993-20b407a12050"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:35.593320 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-978c1de1-f670-454d-ac72-ce48dc35f12a req-cac8a1eb-d005-4fdc-8248-7fa926a967c7 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:35.593766 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-978c1de1-f670-454d-ac72-ce48dc35f12a req-cac8a1eb-d005-4fdc-8248-7fa926a967c7 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:35.605674 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-978c1de1-f670-454d-ac72-ce48dc35f12a req-cac8a1eb-d005-4fdc-8248-7fa926a967c7 service nova] Creating event network-vif-plugged:6ba8813c-0495-42cc-9993-20b407a12050 for instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 on hv-cinder-84327 Jun 16 00:39:35.610544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-978c1de1-f670-454d-ac72-ce48dc35f12a req-cac8a1eb-d005-4fdc-8248-7fa926a967c7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030296 Jun 16 00:39:35.611199 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 539/1098] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:39:36.084853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-5d2e690d-6dc3-42f4-91d5-1fca3784e7cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:36.085460 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-5d2e690d-6dc3-42f4-91d5-1fca3784e7cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:36.091885 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5d2e690d-6dc3-42f4-91d5-1fca3784e7cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:36.092338 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5d2e690d-6dc3-42f4-91d5-1fca3784e7cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:36.093107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5d2e690d-6dc3-42f4-91d5-1fca3784e7cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:36.093549 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-5d2e690d-6dc3-42f4-91d5-1fca3784e7cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:36.219584 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-5d2e690d-6dc3-42f4-91d5-1fca3784e7cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:36.227421 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-5d2e690d-6dc3-42f4-91d5-1fca3784e7cd tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1362 microversion: 2.1 time: 0.146993 Jun 16 00:39:36.228006 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 560/1099] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:36 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:37.244856 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c13cd0e9-735c-4485-8e25-7ae062ee6c7d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:37.245544 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c13cd0e9-735c-4485-8e25-7ae062ee6c7d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:37.252047 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c13cd0e9-735c-4485-8e25-7ae062ee6c7d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:37.252556 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c13cd0e9-735c-4485-8e25-7ae062ee6c7d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:37.253350 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c13cd0e9-735c-4485-8e25-7ae062ee6c7d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:37.253784 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c13cd0e9-735c-4485-8e25-7ae062ee6c7d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:37.384676 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c13cd0e9-735c-4485-8e25-7ae062ee6c7d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:37.392219 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c13cd0e9-735c-4485-8e25-7ae062ee6c7d tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1362 microversion: 2.1 time: 0.152026 Jun 16 00:39:37.392773 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 540/1100] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:37 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:38.409546 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-46954149-a8d9-4438-a2b7-0051f80d9910 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:38.410157 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-46954149-a8d9-4438-a2b7-0051f80d9910 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:38.413135 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:38.413790 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=10 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:38.419496 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-46954149-a8d9-4438-a2b7-0051f80d9910 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:38.419974 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-46954149-a8d9-4438-a2b7-0051f80d9910 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:38.420769 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-46954149-a8d9-4438-a2b7-0051f80d9910 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:38.421214 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-46954149-a8d9-4438-a2b7-0051f80d9910 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:38.548402 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-46954149-a8d9-4438-a2b7-0051f80d9910 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:38.556211 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-46954149-a8d9-4438-a2b7-0051f80d9910 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1548 microversion: 2.1 time: 0.150512 Jun 16 00:39:38.556773 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 561/1101] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:38 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:38.572769 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6a9b53b5-103d-42f3-9f35-db347442cea7 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:38.573265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6a9b53b5-103d-42f3-9f35-db347442cea7 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:38.575172 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:38.580804 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6a9b53b5-103d-42f3-9f35-db347442cea7 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:38.581247 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6a9b53b5-103d-42f3-9f35-db347442cea7 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:38.582000 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6a9b53b5-103d-42f3-9f35-db347442cea7 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:38.582429 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6a9b53b5-103d-42f3-9f35-db347442cea7 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:38.657516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6a9b53b5-103d-42f3-9f35-db347442cea7 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088514 Jun 16 00:39:38.658092 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 541/1102] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jun 16 00:39:38 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:39.788044 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-d43236d2-826f-470d-ba04-0a810b584669 req-b2f6249d-ebfc-43ff-9374-c281ccf1c1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bae4bfa-4af9-47f6-8171-77b606dc88f8", "tag": "6ba8813c-0495-42cc-9993-20b407a12050"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:39.799852 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-d43236d2-826f-470d-ba04-0a810b584669 req-b2f6249d-ebfc-43ff-9374-c281ccf1c1a2 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:39.800393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-d43236d2-826f-470d-ba04-0a810b584669 req-b2f6249d-ebfc-43ff-9374-c281ccf1c1a2 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:39.814037 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-d43236d2-826f-470d-ba04-0a810b584669 req-b2f6249d-ebfc-43ff-9374-c281ccf1c1a2 service nova] Creating event network-changed:6ba8813c-0495-42cc-9993-20b407a12050 for instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 on hv-cinder-84327 Jun 16 00:39:39.819300 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-d43236d2-826f-470d-ba04-0a810b584669 req-b2f6249d-ebfc-43ff-9374-c281ccf1c1a2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035030 Jun 16 00:39:39.819923 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 562/1103] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:06.577476 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:06.578288 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:06.582797 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1117d1e4-ffb5-45d2-85cf-f98d01802ba1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:06.583288 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1117d1e4-ffb5-45d2-85cf-f98d01802ba1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:06.591309 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1117d1e4-ffb5-45d2-85cf-f98d01802ba1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:06.591792 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1117d1e4-ffb5-45d2-85cf-f98d01802ba1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:06.592555 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1117d1e4-ffb5-45d2-85cf-f98d01802ba1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:06.592990 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1117d1e4-ffb5-45d2-85cf-f98d01802ba1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:06.619155 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1117d1e4-ffb5-45d2-85cf-f98d01802ba1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/ips" status: 200 len: 146 microversion: 2.1 time: 0.043659 Jun 16 00:41:06.619729 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 542/1104] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jun 16 00:41:06 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:07.930772 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:07.931575 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=89 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:07.936402 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-30194b1c-3604-4a74-adfa-e229599ee4c2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab0ce035-76ff-4b70-86a7-4b9180eee433"}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:07.937552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-30194b1c-3604-4a74-adfa-e229599ee4c2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:07.945706 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-30194b1c-3604-4a74-adfa-e229599ee4c2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:07.946180 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-30194b1c-3604-4a74-adfa-e229599ee4c2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:07.947152 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-30194b1c-3604-4a74-adfa-e229599ee4c2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:07.947591 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-30194b1c-3604-4a74-adfa-e229599ee4c2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:08.195539 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-30194b1c-3604-4a74-adfa-e229599ee4c2 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "POST /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266781 Jun 16 00:41:08.196181 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 563/1105] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:41:07 2022] POST /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:15.670473 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-7b9f3e01-fa87-4083-bcb4-9af84628f4a3 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:15.671394 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-7b9f3e01-fa87-4083-bcb4-9af84628f4a3 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:15.677854 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7b9f3e01-fa87-4083-bcb4-9af84628f4a3 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:15.678306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7b9f3e01-fa87-4083-bcb4-9af84628f4a3 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:15.679070 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7b9f3e01-fa87-4083-bcb4-9af84628f4a3 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:15.679508 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-7b9f3e01-fa87-4083-bcb4-9af84628f4a3 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:15.707777 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-7b9f3e01-fa87-4083-bcb4-9af84628f4a3 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041516 Jun 16 00:41:15.708313 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 543/1106] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:41:15 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:15.719881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-76d499d4-d535-4fde-bfe9-729c2511c4de tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:15.720488 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-76d499d4-d535-4fde-bfe9-729c2511c4de tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:15.726633 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-76d499d4-d535-4fde-bfe9-729c2511c4de tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:15.727079 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-76d499d4-d535-4fde-bfe9-729c2511c4de tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:15.727868 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-76d499d4-d535-4fde-bfe9-729c2511c4de tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:15.728304 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-76d499d4-d535-4fde-bfe9-729c2511c4de tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:15.755984 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-76d499d4-d535-4fde-bfe9-729c2511c4de tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments/ab0ce035-76ff-4b70-86a7-4b9180eee433" status: 200 len: 194 microversion: 2.1 time: 0.040822 Jun 16 00:41:15.757041 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 564/1107] 10.222.0.44 () {58 vars in 1412 bytes} [Thu Jun 16 00:41:15 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments/ab0ce035-76ff-4b70-86a7-4b9180eee433 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:17.062478 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a1b60773-aeaa-4702-9d5a-3963928ecb7e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf60e523-63e1-4b56-8a5d-3a737ef0e59a"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:17.063487 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a1b60773-aeaa-4702-9d5a-3963928ecb7e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:17.070460 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a1b60773-aeaa-4702-9d5a-3963928ecb7e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:17.070904 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a1b60773-aeaa-4702-9d5a-3963928ecb7e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:17.071684 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a1b60773-aeaa-4702-9d5a-3963928ecb7e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:17.072116 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a1b60773-aeaa-4702-9d5a-3963928ecb7e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:17.396588 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a1b60773-aeaa-4702-9d5a-3963928ecb7e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "POST /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337820 Jun 16 00:41:17.397187 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 544/1108] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:41:17 2022] POST /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:24.879144 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-cc65a2c2-b295-45ee-a5c3-11d59f8f6e20 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:24.880104 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-cc65a2c2-b295-45ee-a5c3-11d59f8f6e20 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:24.887552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cc65a2c2-b295-45ee-a5c3-11d59f8f6e20 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:24.888049 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cc65a2c2-b295-45ee-a5c3-11d59f8f6e20 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:24.888833 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cc65a2c2-b295-45ee-a5c3-11d59f8f6e20 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:24.889270 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-cc65a2c2-b295-45ee-a5c3-11d59f8f6e20 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:24.918479 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-cc65a2c2-b295-45ee-a5c3-11d59f8f6e20 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043230 Jun 16 00:41:24.919018 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 565/1109] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:41:24 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:25.061545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-539a48c1-7303-4521-9664-271c09fad50e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:25.062080 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-539a48c1-7303-4521-9664-271c09fad50e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:25.068737 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-539a48c1-7303-4521-9664-271c09fad50e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:25.069190 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-539a48c1-7303-4521-9664-271c09fad50e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:25.070588 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-539a48c1-7303-4521-9664-271c09fad50e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:25.071028 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-539a48c1-7303-4521-9664-271c09fad50e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:25.098659 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-539a48c1-7303-4521-9664-271c09fad50e tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments/ab0ce035-76ff-4b70-86a7-4b9180eee433" status: 200 len: 194 microversion: 2.1 time: 0.041461 Jun 16 00:41:25.099226 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 545/1110] 10.222.0.44 () {58 vars in 1412 bytes} [Thu Jun 16 00:41:25 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments/ab0ce035-76ff-4b70-86a7-4b9180eee433 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:25.108638 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c66d990b-d127-4ef1-acd2-668787f05708 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:25.109124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c66d990b-d127-4ef1-acd2-668787f05708 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:25.115007 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c66d990b-d127-4ef1-acd2-668787f05708 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:25.115447 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c66d990b-d127-4ef1-acd2-668787f05708 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:25.116244 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c66d990b-d127-4ef1-acd2-668787f05708 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:25.117241 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c66d990b-d127-4ef1-acd2-668787f05708 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:25.252031 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.objects.instance [None req-c66d990b-d127-4ef1-acd2-668787f05708 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lazy-loading 'services' on Instance uuid 3bae4bfa-4af9-47f6-8171-77b606dc88f8 {{(pid=129466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:41:25.321275 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c66d990b-d127-4ef1-acd2-668787f05708 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments/ab0ce035-76ff-4b70-86a7-4b9180eee433" status: 202 len: 0 microversion: 2.1 time: 0.216314 Jun 16 00:41:25.321776 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 566/1111] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 16 00:41:25 2022] DELETE /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments/ab0ce035-76ff-4b70-86a7-4b9180eee433 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:41:25.415874 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:41:25.416091 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Thu Jun 16 00:41:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:41:27.480493 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b139c6c3-1292-4323-82e4-7fb9af0262d1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:27.481077 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b139c6c3-1292-4323-82e4-7fb9af0262d1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:27.487488 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b139c6c3-1292-4323-82e4-7fb9af0262d1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:27.487987 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b139c6c3-1292-4323-82e4-7fb9af0262d1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:27.488742 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b139c6c3-1292-4323-82e4-7fb9af0262d1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:27.489171 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b139c6c3-1292-4323-82e4-7fb9af0262d1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:27.517085 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b139c6c3-1292-4323-82e4-7fb9af0262d1 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments/bf60e523-63e1-4b56-8a5d-3a737ef0e59a" status: 200 len: 194 microversion: 2.1 time: 0.041048 Jun 16 00:41:27.517639 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 546/1112] 10.222.0.44 () {58 vars in 1412 bytes} [Thu Jun 16 00:41:27 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments/bf60e523-63e1-4b56-8a5d-3a737ef0e59a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:27.528212 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-90b6411c-53bb-4d47-a7dc-f6ceee5ef396 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:27.528823 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-90b6411c-53bb-4d47-a7dc-f6ceee5ef396 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:27.534964 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-90b6411c-53bb-4d47-a7dc-f6ceee5ef396 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:27.535409 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-90b6411c-53bb-4d47-a7dc-f6ceee5ef396 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:27.536204 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-90b6411c-53bb-4d47-a7dc-f6ceee5ef396 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:27.536638 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-90b6411c-53bb-4d47-a7dc-f6ceee5ef396 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:27.614424 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.objects.instance [None req-90b6411c-53bb-4d47-a7dc-f6ceee5ef396 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lazy-loading 'services' on Instance uuid 3bae4bfa-4af9-47f6-8171-77b606dc88f8 {{(pid=129466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:41:27.684401 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-90b6411c-53bb-4d47-a7dc-f6ceee5ef396 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments/bf60e523-63e1-4b56-8a5d-3a737ef0e59a" status: 202 len: 0 microversion: 2.1 time: 0.160706 Jun 16 00:41:27.684936 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 567/1113] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 16 00:41:27 2022] DELETE /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments/bf60e523-63e1-4b56-8a5d-3a737ef0e59a => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:41:28.838483 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-be17543b-5462-4611-9556-8c19d3c21620 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:28.839412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-be17543b-5462-4611-9556-8c19d3c21620 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:28.845763 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-be17543b-5462-4611-9556-8c19d3c21620 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:28.846204 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-be17543b-5462-4611-9556-8c19d3c21620 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:28.846956 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-be17543b-5462-4611-9556-8c19d3c21620 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:28.847389 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-be17543b-5462-4611-9556-8c19d3c21620 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:28.875498 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-be17543b-5462-4611-9556-8c19d3c21620 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040925 Jun 16 00:41:28.876055 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 547/1114] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:41:28 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:41:28.978035 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4e302845-b407-408d-97ad-434924aae57c tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:28.979094 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4e302845-b407-408d-97ad-434924aae57c tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:28.985718 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4e302845-b407-408d-97ad-434924aae57c tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:28.986162 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4e302845-b407-408d-97ad-434924aae57c tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:28.986924 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4e302845-b407-408d-97ad-434924aae57c tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:28.987361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4e302845-b407-408d-97ad-434924aae57c tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:29.015399 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4e302845-b407-408d-97ad-434924aae57c tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042066 Jun 16 00:41:29.015900 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 568/1115] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jun 16 00:41:28 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:41:29.071353 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-74078ab7-27e6-4709-b567-6086c86d490b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:29.071878 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-74078ab7-27e6-4709-b567-6086c86d490b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:29.077798 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-74078ab7-27e6-4709-b567-6086c86d490b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:29.078242 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-74078ab7-27e6-4709-b567-6086c86d490b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:29.078989 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-74078ab7-27e6-4709-b567-6086c86d490b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:29.079419 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-74078ab7-27e6-4709-b567-6086c86d490b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:29.103571 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-74078ab7-27e6-4709-b567-6086c86d490b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Going to try to terminate instance {{(pid=129465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:41:29.174149 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-74078ab7-27e6-4709-b567-6086c86d490b tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 204 len: 0 microversion: 2.1 time: 0.106326 Jun 16 00:41:29.174764 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 548/1116] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:41:29 2022] DELETE /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:41:29.183492 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4a0b9a75-8560-4e5c-a229-3133e3ee892a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:29.184170 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4a0b9a75-8560-4e5c-a229-3133e3ee892a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:29.190196 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4a0b9a75-8560-4e5c-a229-3133e3ee892a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:29.190645 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4a0b9a75-8560-4e5c-a229-3133e3ee892a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:29.191405 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4a0b9a75-8560-4e5c-a229-3133e3ee892a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:29.191869 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4a0b9a75-8560-4e5c-a229-3133e3ee892a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:29.319561 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4a0b9a75-8560-4e5c-a229-3133e3ee892a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:29.327550 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4a0b9a75-8560-4e5c-a229-3133e3ee892a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1673 microversion: 2.1 time: 0.148414 Jun 16 00:41:29.328133 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 569/1117] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:29 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:30.345179 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2472c6f7-3818-4125-b071-c446e29606c6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:30.345839 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2472c6f7-3818-4125-b071-c446e29606c6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:30.352899 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2472c6f7-3818-4125-b071-c446e29606c6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:30.353346 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2472c6f7-3818-4125-b071-c446e29606c6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:30.354113 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2472c6f7-3818-4125-b071-c446e29606c6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:30.354550 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2472c6f7-3818-4125-b071-c446e29606c6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:30.486051 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-2472c6f7-3818-4125-b071-c446e29606c6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:30.493418 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2472c6f7-3818-4125-b071-c446e29606c6 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1673 microversion: 2.1 time: 0.152478 Jun 16 00:41:30.493969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 549/1118] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:30 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:31.510187 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-effac1ef-7c7e-4c38-8739-e814907c0d19 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:31.511172 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-effac1ef-7c7e-4c38-8739-e814907c0d19 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:31.517647 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-effac1ef-7c7e-4c38-8739-e814907c0d19 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:31.518098 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-effac1ef-7c7e-4c38-8739-e814907c0d19 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:31.518861 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-effac1ef-7c7e-4c38-8739-e814907c0d19 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:31.520762 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-effac1ef-7c7e-4c38-8739-e814907c0d19 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:31.649220 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-effac1ef-7c7e-4c38-8739-e814907c0d19 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:31.656910 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-effac1ef-7c7e-4c38-8739-e814907c0d19 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1673 microversion: 2.1 time: 0.150563 Jun 16 00:41:31.657478 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 570/1119] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:31 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:32.478209 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-1ad338e0-9f6b-42eb-b3db-12b03af0e14f req-577d3200-ee53-45a8-87f8-6ffbe09c449d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bae4bfa-4af9-47f6-8171-77b606dc88f8", "name": "network-vif-deleted", "tag": "6ba8813c-0495-42cc-9993-20b407a12050"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:32.487506 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-1ad338e0-9f6b-42eb-b3db-12b03af0e14f req-577d3200-ee53-45a8-87f8-6ffbe09c449d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:32.487978 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-1ad338e0-9f6b-42eb-b3db-12b03af0e14f req-577d3200-ee53-45a8-87f8-6ffbe09c449d service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:32.501516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-1ad338e0-9f6b-42eb-b3db-12b03af0e14f req-577d3200-ee53-45a8-87f8-6ffbe09c449d service nova] Creating event network-vif-deleted:6ba8813c-0495-42cc-9993-20b407a12050 for instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 on hv-cinder-84327 Jun 16 00:41:32.507172 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-1ad338e0-9f6b-42eb-b3db-12b03af0e14f req-577d3200-ee53-45a8-87f8-6ffbe09c449d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032734 Jun 16 00:41:32.508202 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 550/1120] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:32.674740 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2037567a-1042-408e-a088-518f0b77e6fa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:32.675379 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2037567a-1042-408e-a088-518f0b77e6fa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:32.681679 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2037567a-1042-408e-a088-518f0b77e6fa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:32.682129 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2037567a-1042-408e-a088-518f0b77e6fa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:32.682901 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2037567a-1042-408e-a088-518f0b77e6fa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:32.683341 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2037567a-1042-408e-a088-518f0b77e6fa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:32.715221 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2037567a-1042-408e-a088-518f0b77e6fa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:32.715705 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2037567a-1042-408e-a088-518f0b77e6fa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:32.716202 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.objects.instance [None req-2037567a-1042-408e-a088-518f0b77e6fa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lazy-loading 'fault' on Instance uuid 3bae4bfa-4af9-47f6-8171-77b606dc88f8 {{(pid=129466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:41:32.759987 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2037567a-1042-408e-a088-518f0b77e6fa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3855abd7ea410fa64d546b3a85ff31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985ab6e44f6d4425a2def9b3a52262d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:32.767749 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2037567a-1042-408e-a088-518f0b77e6fa tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 200 len: 1326 microversion: 2.1 time: 0.097013 Jun 16 00:41:32.768337 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 571/1121] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:32 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:33.786503 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d2f2604b-f149-4a55-982b-6a1b262e17f5 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:33.787150 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d2f2604b-f149-4a55-982b-6a1b262e17f5 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:33.793395 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d2f2604b-f149-4a55-982b-6a1b262e17f5 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:33.793844 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d2f2604b-f149-4a55-982b-6a1b262e17f5 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:33.794605 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d2f2604b-f149-4a55-982b-6a1b262e17f5 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:33.795041 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d2f2604b-f149-4a55-982b-6a1b262e17f5 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:33.808679 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-d2f2604b-f149-4a55-982b-6a1b262e17f5 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] HTTP exception thrown: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d2f2604b-f149-4a55-982b-6a1b262e17f5 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Request method failure captured: Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 HTTP/1.1 Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnpvG51OdQg8qboD6ehSgdV57fAY_VA9mqk8ViJmWrOzGcpoZjqh_k0fYXjrRuZ3dH9R8Yiahzyb7zEJXHvKOfbrdzRhX9n_o1em3FJLTzk9xeapxJPF5RMWLV3xF9Hu3azBiNAdiMqoF2daIgL6w6UEqNvOp-FaFkILhH5soDX9iSs Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 985ab6e44f6d4425a2def9b3a52262d8 Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:41:33.810267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:41:33.811836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:41:33.811836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:33.811836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 985ab6e44f6d4425a2def9b3a52262d8 Jun 16 00:41:33.811836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:33.811836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeTestJSON-597140553-project Jun 16 00:41:33.811836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:41:33.811836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:41:33.811836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: 9e3855abd7ea410fa64d546b3a85ff31 Jun 16 00:41:33.811836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeTestJSON-597140553-project Jun 16 00:41:33.811836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:41:33.811836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:33.811836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '3bae4bfa-4af9-47f6-8171-77b606dc88f8'} Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:33.812657 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:33.814334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:33.816106 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d2f2604b-f149-4a55-982b-6a1b262e17f5 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Returning 404 to user: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:33.816106 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d2f2604b-f149-4a55-982b-6a1b262e17f5 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 404 len: 111 microversion: 2.1 time: 0.029937 Jun 16 00:41:33.816106 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 551/1122] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:33 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:41:33.821192 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a70484bb-0a8b-46fc-bde1-6728d72b1c31 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '.version_select at 0x7f9573c8d790>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:33.838160 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a70484bb-0a8b-46fc-bde1-6728d72b1c31 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-180255684" status: 202 len: 0 microversion: 2.1 time: 0.021382 Jun 16 00:41:33.838706 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 572/1123] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jun 16 00:41:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-180255684 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:41:36.675720 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-eda93574-4534-4ba4-8f7c-60acc12f0e24 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:36.676251 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-eda93574-4534-4ba4-8f7c-60acc12f0e24 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:36.678840 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:36.685326 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eda93574-4534-4ba4-8f7c-60acc12f0e24 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:36.685769 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eda93574-4534-4ba4-8f7c-60acc12f0e24 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:36.686532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eda93574-4534-4ba4-8f7c-60acc12f0e24 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:36.686993 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-eda93574-4534-4ba4-8f7c-60acc12f0e24 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:36.691445 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:36.701282 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-eda93574-4534-4ba4-8f7c-60acc12f0e24 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] HTTP exception thrown: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-eda93574-4534-4ba4-8f7c-60acc12f0e24 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Request method failure captured: Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: DELETE /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 HTTP/1.1 Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnpvG51OdQg8qboD6ehSgdV57fAY_VA9mqk8ViJmWrOzGcpoZjqh_k0fYXjrRuZ3dH9R8Yiahzyb7zEJXHvKOfbrdzRhX9n_o1em3FJLTzk9xeapxJPF5RMWLV3xF9Hu3azBiNAdiMqoF2daIgL6w6UEqNvOp-FaFkILhH5soDX9iSs Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 985ab6e44f6d4425a2def9b3a52262d8 Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:41:36.708195 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:41:36.709845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:41:36.709845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:36.709845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 985ab6e44f6d4425a2def9b3a52262d8 Jun 16 00:41:36.709845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:36.709845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeTestJSON-597140553-project Jun 16 00:41:36.709845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:41:36.709845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:41:36.709845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: 9e3855abd7ea410fa64d546b3a85ff31 Jun 16 00:41:36.709845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeTestJSON-597140553-project Jun 16 00:41:36.709845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:41:36.709845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:36.709845 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '3bae4bfa-4af9-47f6-8171-77b606dc88f8'} Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:36.710781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:36.712898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:36.714708 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-eda93574-4534-4ba4-8f7c-60acc12f0e24 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Returning 404 to user: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:36.714708 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-eda93574-4534-4ba4-8f7c-60acc12f0e24 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 404 len: 111 microversion: 2.1 time: 0.037755 Jun 16 00:41:36.714708 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 552/1124] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:41:36 2022] DELETE /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:41:36.719982 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-63f579ac-14b1-49f2-b604-5626373f1977 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:36.720585 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-63f579ac-14b1-49f2-b604-5626373f1977 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: 3bae4bfa-4af9-47f6-8171-77b606dc88f8] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:36.727853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63f579ac-14b1-49f2-b604-5626373f1977 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:36.728298 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63f579ac-14b1-49f2-b604-5626373f1977 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:36.729057 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63f579ac-14b1-49f2-b604-5626373f1977 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:36.729489 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63f579ac-14b1-49f2-b604-5626373f1977 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:36.742535 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-63f579ac-14b1-49f2-b604-5626373f1977 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] HTTP exception thrown: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-63f579ac-14b1-49f2-b604-5626373f1977 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Request method failure captured: Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 HTTP/1.1 Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnpvG51OdQg8qboD6ehSgdV57fAY_VA9mqk8ViJmWrOzGcpoZjqh_k0fYXjrRuZ3dH9R8Yiahzyb7zEJXHvKOfbrdzRhX9n_o1em3FJLTzk9xeapxJPF5RMWLV3xF9Hu3azBiNAdiMqoF2daIgL6w6UEqNvOp-FaFkILhH5soDX9iSs Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 985ab6e44f6d4425a2def9b3a52262d8 Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:41:36.744227 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:41:36.745810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:41:36.745810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:36.745810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 985ab6e44f6d4425a2def9b3a52262d8 Jun 16 00:41:36.745810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:36.745810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-AttachVolumeTestJSON-597140553-project Jun 16 00:41:36.745810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:41:36.745810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:41:36.745810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: 9e3855abd7ea410fa64d546b3a85ff31 Jun 16 00:41:36.745810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-AttachVolumeTestJSON-597140553-project Jun 16 00:41:36.745810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:41:36.745810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:36.745810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '3bae4bfa-4af9-47f6-8171-77b606dc88f8'} Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:36.749268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. Jun 16 00:41:36.750857 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:36.752675 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-63f579ac-14b1-49f2-b604-5626373f1977 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Returning 404 to user: Instance 3bae4bfa-4af9-47f6-8171-77b606dc88f8 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:36.752675 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-63f579ac-14b1-49f2-b604-5626373f1977 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8" status: 404 len: 111 microversion: 2.1 time: 0.030052 Jun 16 00:41:36.752675 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 573/1125] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:36 2022] GET /compute/v2.1/servers/3bae4bfa-4af9-47f6-8171-77b606dc88f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:41:37.878356 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8760bafb-78ad-448b-b2bf-d026a4d09067 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:37.878852 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8760bafb-78ad-448b-b2bf-d026a4d09067 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:37.886620 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8760bafb-78ad-448b-b2bf-d026a4d09067 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:37.887065 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8760bafb-78ad-448b-b2bf-d026a4d09067 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:37.887861 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8760bafb-78ad-448b-b2bf-d026a4d09067 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:37.888304 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8760bafb-78ad-448b-b2bf-d026a4d09067 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:37.902308 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-8760bafb-78ad-448b-b2bf-d026a4d09067 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] HTTP exception thrown: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8760bafb-78ad-448b-b2bf-d026a4d09067 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Request method failure captured: Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: DELETE /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 HTTP/1.1 Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnpvG51OdQg8qboD6ehSgdV57fAY_VA9mqk8ViJmWrOzGcpoZjqh_k0fYXjrRuZ3dH9R8Yiahzyb7zEJXHvKOfbrdzRhX9n_o1em3FJLTzk9xeapxJPF5RMWLV3xF9Hu3azBiNAdiMqoF2daIgL6w6UEqNvOp-FaFkILhH5soDX9iSs Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: 985ab6e44f6d4425a2def9b3a52262d8 Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:41:37.903857 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:41:37.905516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:41:37.905516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:37.905516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: 985ab6e44f6d4425a2def9b3a52262d8 Jun 16 00:41:37.905516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:37.905516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-AttachVolumeTestJSON-597140553-project Jun 16 00:41:37.905516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:41:37.905516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:41:37.905516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: 9e3855abd7ea410fa64d546b3a85ff31 Jun 16 00:41:37.905516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-AttachVolumeTestJSON-597140553-project Jun 16 00:41:37.905516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:41:37.905516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:41:37.905516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': 'b3f39b67-fe8c-4a0a-8ac8-ca589391af83'} Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:37.906480 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:41:37.908040 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:41:37.909698 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8760bafb-78ad-448b-b2bf-d026a4d09067 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Returning 404 to user: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:37.909698 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8760bafb-78ad-448b-b2bf-d026a4d09067 tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 404 len: 111 microversion: 2.1 time: 0.031103 Jun 16 00:41:37.909698 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 553/1126] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:41:37 2022] DELETE /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:41:37.914723 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0abe9f8e-689a-46c3-b41f-b7be00631d7a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:37.915915 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-0abe9f8e-689a-46c3-b41f-b7be00631d7a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] [instance: b3f39b67-fe8c-4a0a-8ac8-ca589391af83] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:37.922356 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0abe9f8e-689a-46c3-b41f-b7be00631d7a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:37.922807 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0abe9f8e-689a-46c3-b41f-b7be00631d7a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:37.923728 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0abe9f8e-689a-46c3-b41f-b7be00631d7a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:37.924285 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-0abe9f8e-689a-46c3-b41f-b7be00631d7a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:37.938807 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-0abe9f8e-689a-46c3-b41f-b7be00631d7a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] HTTP exception thrown: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0abe9f8e-689a-46c3-b41f-b7be00631d7a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Request method failure captured: Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 HTTP/1.1 Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnpvG51OdQg8qboD6ehSgdV57fAY_VA9mqk8ViJmWrOzGcpoZjqh_k0fYXjrRuZ3dH9R8Yiahzyb7zEJXHvKOfbrdzRhX9n_o1em3FJLTzk9xeapxJPF5RMWLV3xF9Hu3azBiNAdiMqoF2daIgL6w6UEqNvOp-FaFkILhH5soDX9iSs Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: 985ab6e44f6d4425a2def9b3a52262d8 Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:41:37.940343 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:41:37.941998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/985ab6e44f6d4425a2def9b3a52262d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:41:37.941998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:37.941998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: 985ab6e44f6d4425a2def9b3a52262d8 Jun 16 00:41:37.941998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-AttachVolumeTestJSON-597140553 Jun 16 00:41:37.941998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-AttachVolumeTestJSON-597140553-project Jun 16 00:41:37.941998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:41:37.941998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:41:37.941998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: 9e3855abd7ea410fa64d546b3a85ff31 Jun 16 00:41:37.941998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-AttachVolumeTestJSON-597140553-project Jun 16 00:41:37.941998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:41:37.941998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:41:37.941998 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': 'b3f39b67-fe8c-4a0a-8ac8-ca589391af83'} Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:37.943109 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. Jun 16 00:41:37.944629 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:37.946107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-0abe9f8e-689a-46c3-b41f-b7be00631d7a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] Returning 404 to user: Instance b3f39b67-fe8c-4a0a-8ac8-ca589391af83 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:37.946107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-0abe9f8e-689a-46c3-b41f-b7be00631d7a tempest-AttachVolumeTestJSON-597140553 tempest-AttachVolumeTestJSON-597140553-project] 10.222.0.44 "GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83" status: 404 len: 111 microversion: 2.1 time: 0.031560 Jun 16 00:41:37.946107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 574/1127] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:37 2022] GET /compute/v2.1/servers/b3f39b67-fe8c-4a0a-8ac8-ca589391af83 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:41:41.979179 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:41:41.979773 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Thu Jun 16 00:41:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:41:45.019670 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d3810be4-4964-49b4-ac26-fe7b2ef75fb6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:45.020267 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d3810be4-4964-49b4-ac26-fe7b2ef75fb6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:45.026680 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d3810be4-4964-49b4-ac26-fe7b2ef75fb6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:45.027137 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d3810be4-4964-49b4-ac26-fe7b2ef75fb6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:45.027943 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d3810be4-4964-49b4-ac26-fe7b2ef75fb6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:45.028386 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d3810be4-4964-49b4-ac26-fe7b2ef75fb6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:45.052842 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d3810be4-4964-49b4-ac26-fe7b2ef75fb6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Going to try to terminate instance {{(pid=129465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:41:45.130401 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d3810be4-4964-49b4-ac26-fe7b2ef75fb6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 204 len: 0 microversion: 2.1 time: 0.114280 Jun 16 00:41:45.131215 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 554/1128] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:41:45 2022] DELETE /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:41:45.140300 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e170ed4f-77f7-47ff-a7e9-0e18dcdc91e7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:45.141003 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e170ed4f-77f7-47ff-a7e9-0e18dcdc91e7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:45.144583 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:45.148912 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e170ed4f-77f7-47ff-a7e9-0e18dcdc91e7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:45.149396 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e170ed4f-77f7-47ff-a7e9-0e18dcdc91e7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:45.150147 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e170ed4f-77f7-47ff-a7e9-0e18dcdc91e7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:45.150589 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e170ed4f-77f7-47ff-a7e9-0e18dcdc91e7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:45.153775 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:45.283872 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e170ed4f-77f7-47ff-a7e9-0e18dcdc91e7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:45.291432 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e170ed4f-77f7-47ff-a7e9-0e18dcdc91e7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1576 microversion: 2.1 time: 0.154862 Jun 16 00:41:45.291946 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 575/1129] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:45 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:46.309536 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c647ec7f-63c5-4623-ae9d-75641dcfe913 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:46.310225 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c647ec7f-63c5-4623-ae9d-75641dcfe913 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:46.316278 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c647ec7f-63c5-4623-ae9d-75641dcfe913 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:46.316724 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c647ec7f-63c5-4623-ae9d-75641dcfe913 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:46.317513 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c647ec7f-63c5-4623-ae9d-75641dcfe913 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:46.317945 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c647ec7f-63c5-4623-ae9d-75641dcfe913 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:46.451237 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c647ec7f-63c5-4623-ae9d-75641dcfe913 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:46.459892 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c647ec7f-63c5-4623-ae9d-75641dcfe913 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1576 microversion: 2.1 time: 0.154411 Jun 16 00:41:46.460603 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 555/1130] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:46 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:47.477649 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a83bb85a-5a9e-404a-9bbd-b1a1dda5df21 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:47.479059 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a83bb85a-5a9e-404a-9bbd-b1a1dda5df21 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:47.488034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a83bb85a-5a9e-404a-9bbd-b1a1dda5df21 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:47.488680 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a83bb85a-5a9e-404a-9bbd-b1a1dda5df21 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:47.489630 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a83bb85a-5a9e-404a-9bbd-b1a1dda5df21 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:47.490223 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a83bb85a-5a9e-404a-9bbd-b1a1dda5df21 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:47.574706 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a83bb85a-5a9e-404a-9bbd-b1a1dda5df21 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:47.592413 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a83bb85a-5a9e-404a-9bbd-b1a1dda5df21 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 200 len: 1509 microversion: 2.1 time: 0.119035 Jun 16 00:41:47.593029 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 576/1131] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:47 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 1509 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:47.768148 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-6c7e9b79-9c2c-4a39-bd2a-b45062194a86 req-20213983-54b8-44b1-8302-42930392b876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4813890-4093-4866-b4c6-fbbbed962872", "name": "network-vif-deleted", "tag": "74cc5c9c-50cf-4243-b8a8-e4f4dbaa8d86"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:47.781062 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-6c7e9b79-9c2c-4a39-bd2a-b45062194a86 req-20213983-54b8-44b1-8302-42930392b876 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:47.782426 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-6c7e9b79-9c2c-4a39-bd2a-b45062194a86 req-20213983-54b8-44b1-8302-42930392b876 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:47.796590 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-6c7e9b79-9c2c-4a39-bd2a-b45062194a86 req-20213983-54b8-44b1-8302-42930392b876 service nova] Creating event network-vif-deleted:74cc5c9c-50cf-4243-b8a8-e4f4dbaa8d86 for instance d4813890-4093-4866-b4c6-fbbbed962872 on hv-cinder-84327 Jun 16 00:41:47.807704 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-6c7e9b79-9c2c-4a39-bd2a-b45062194a86 req-20213983-54b8-44b1-8302-42930392b876 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043044 Jun 16 00:41:47.812116 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 556/1132] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:48.610832 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-156814b4-17f5-4c7e-86b9-f8ce5add84dc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:48.611454 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-156814b4-17f5-4c7e-86b9-f8ce5add84dc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:48.623976 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-156814b4-17f5-4c7e-86b9-f8ce5add84dc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:48.624447 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-156814b4-17f5-4c7e-86b9-f8ce5add84dc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:48.625449 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-156814b4-17f5-4c7e-86b9-f8ce5add84dc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:48.625888 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-156814b4-17f5-4c7e-86b9-f8ce5add84dc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:48.642120 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-156814b4-17f5-4c7e-86b9-f8ce5add84dc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] HTTP exception thrown: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-156814b4-17f5-4c7e-86b9-f8ce5add84dc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Request method failure captured: Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 HTTP/1.1 Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnuOm9s92YYhb_jYOtONR4QLHSjvosqt6zjWKgEhm6lR7bLiG-fS4yjF6957JhB9Dp9C_6NyyWP3Eedu_I0IOp1_PBNwz8V2EJnUGIzpJ1RjCZIant94teA2QJp3Y1xhTWnwoeSNOgSLJvN2i4rYCrPZMj43sxr2cY6byfFAMs8Mtbo Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: e0d870e67f68470988dd26ac7aef3fec Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-TestVolumeBootPattern-34596046 Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:41:48.643938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:41:48.645945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:41:48.645945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-TestVolumeBootPattern-34596046 Jun 16 00:41:48.645945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: e0d870e67f68470988dd26ac7aef3fec Jun 16 00:41:48.645945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-TestVolumeBootPattern-34596046 Jun 16 00:41:48.645945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-TestVolumeBootPattern-34596046-project Jun 16 00:41:48.645945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:41:48.645945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:41:48.645945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: c9f93af4621b4a9db098c299c9e32c20 Jun 16 00:41:48.645945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-TestVolumeBootPattern-34596046-project Jun 16 00:41:48.645945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:41:48.645945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:41:48.645945 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': 'd4813890-4093-4866-b4c6-fbbbed962872'} Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:48.647045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:41:48.648448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:41:48.650881 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-156814b4-17f5-4c7e-86b9-f8ce5add84dc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Returning 404 to user: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:48.651793 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-156814b4-17f5-4c7e-86b9-f8ce5add84dc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 404 len: 111 microversion: 2.1 time: 0.044953 Jun 16 00:41:48.652360 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 577/1133] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:48 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:41:48.756752 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1268595361", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1794881766", "security_groups": [{"name": "tempest-secgroup-smoke-596553076"}], "block_device_mapping_v2": [{"uuid": "6c4e892e-14a4-4e5d-9eb8-eec031097966", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c76d405a-2e1d-4834-ac04-fe5df400b255"}]}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:48.883488 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] validate_networks() for [('c76d405a-2e1d-4834-ac04-fe5df400b255', None, None, None, None, None)] {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:41:49.356677 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:41:49.357103 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:41:49.357579 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:41:49.357992 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:41:49.358408 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:41:49.367180 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:49.367717 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:49.368531 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:49.368976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:49.387079 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Getting quotas for project e0d870e67f68470988dd26ac7aef3fec. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:41:49.391422 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Getting quotas for user c9f93af4621b4a9db098c299c9e32c20 and project e0d870e67f68470988dd26ac7aef3fec. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:41:49.451873 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:41:49.454037 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c4e892e-14a4-4e5d-9eb8-eec031097966',volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:41:49.599738 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2436db7e-7eb0-4dd9-af7f-e3a67913a783 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.847217 Jun 16 00:41:49.600423 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 557/1134] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:41:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:41:49.611159 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-bce6d9e7-4f3a-418e-85d6-247c7fc3f4a8 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:49.611810 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-bce6d9e7-4f3a-418e-85d6-247c7fc3f4a8 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:49.666238 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-bce6d9e7-4f3a-418e-85d6-247c7fc3f4a8 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:49.673069 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-bce6d9e7-4f3a-418e-85d6-247c7fc3f4a8 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1095 microversion: 2.1 time: 0.065775 Jun 16 00:41:49.673623 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 578/1135] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:49 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:50.692897 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-fbbd8c45-9cce-4340-89a3-7ae394de737b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:50.694346 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-fbbd8c45-9cce-4340-89a3-7ae394de737b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:50.704333 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fbbd8c45-9cce-4340-89a3-7ae394de737b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:50.704965 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fbbd8c45-9cce-4340-89a3-7ae394de737b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:50.706089 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fbbd8c45-9cce-4340-89a3-7ae394de737b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:50.706994 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-fbbd8c45-9cce-4340-89a3-7ae394de737b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:50.810089 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-fbbd8c45-9cce-4340-89a3-7ae394de737b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:50.820532 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-fbbd8c45-9cce-4340-89a3-7ae394de737b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1211 microversion: 2.1 time: 0.133308 Jun 16 00:41:50.821775 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 558/1136] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:50 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1211 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:51.839556 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-77d15843-e7d5-4528-a996-26630744d2e1 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:51.840203 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-77d15843-e7d5-4528-a996-26630744d2e1 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:51.850504 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-77d15843-e7d5-4528-a996-26630744d2e1 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:51.851638 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-77d15843-e7d5-4528-a996-26630744d2e1 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:51.852487 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-77d15843-e7d5-4528-a996-26630744d2e1 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:51.853244 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-77d15843-e7d5-4528-a996-26630744d2e1 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:51.907183 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-dac99074-9515-4652-a454-7553286e9054 req-e41dd488-718e-4b21-bf53-14867fddde96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ca7fdf2-0f00-4e8a-9521-98dcd57c5219", "tag": "26f5e2a7-f5fa-4003-a9df-46464649afd5"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:51.919810 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-dac99074-9515-4652-a454-7553286e9054 req-e41dd488-718e-4b21-bf53-14867fddde96 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:51.920317 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-dac99074-9515-4652-a454-7553286e9054 req-e41dd488-718e-4b21-bf53-14867fddde96 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:51.941475 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-dac99074-9515-4652-a454-7553286e9054 req-e41dd488-718e-4b21-bf53-14867fddde96 service nova] Creating event network-changed:26f5e2a7-f5fa-4003-a9df-46464649afd5 for instance 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 on hv-cinder-84327 Jun 16 00:41:51.946637 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-dac99074-9515-4652-a454-7553286e9054 req-e41dd488-718e-4b21-bf53-14867fddde96 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044403 Jun 16 00:41:51.947334 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 559/1137] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:51.996144 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-77d15843-e7d5-4528-a996-26630744d2e1 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:52.004113 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-77d15843-e7d5-4528-a996-26630744d2e1 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1278 microversion: 2.1 time: 0.169044 Jun 16 00:41:52.004689 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 579/1138] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:51 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:53.021807 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f64cda66-2a73-4b11-b232-46ea9f7b0d07 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:53.022499 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f64cda66-2a73-4b11-b232-46ea9f7b0d07 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:53.028764 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f64cda66-2a73-4b11-b232-46ea9f7b0d07 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:53.029215 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f64cda66-2a73-4b11-b232-46ea9f7b0d07 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:53.029976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f64cda66-2a73-4b11-b232-46ea9f7b0d07 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:53.030412 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f64cda66-2a73-4b11-b232-46ea9f7b0d07 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:53.157537 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f64cda66-2a73-4b11-b232-46ea9f7b0d07 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:53.165388 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f64cda66-2a73-4b11-b232-46ea9f7b0d07 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1278 microversion: 2.1 time: 0.148173 Jun 16 00:41:53.165943 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 560/1139] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:53 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:54.182303 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f61a3c8c-ccb5-4bb6-89e9-52c1942cfb3a tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:54.182909 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f61a3c8c-ccb5-4bb6-89e9-52c1942cfb3a tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:54.189347 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f61a3c8c-ccb5-4bb6-89e9-52c1942cfb3a tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:54.189796 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f61a3c8c-ccb5-4bb6-89e9-52c1942cfb3a tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:54.190556 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f61a3c8c-ccb5-4bb6-89e9-52c1942cfb3a tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:54.190990 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f61a3c8c-ccb5-4bb6-89e9-52c1942cfb3a tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:54.320883 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f61a3c8c-ccb5-4bb6-89e9-52c1942cfb3a tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:54.328223 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f61a3c8c-ccb5-4bb6-89e9-52c1942cfb3a tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1278 microversion: 2.1 time: 0.150305 Jun 16 00:41:54.328784 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 580/1140] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:54 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:41:55.345150 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1e0fd6b6-9cca-4e13-bc19-1f20525273c2 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:55.345783 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1e0fd6b6-9cca-4e13-bc19-1f20525273c2 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:55.352430 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1e0fd6b6-9cca-4e13-bc19-1f20525273c2 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:55.352784 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1e0fd6b6-9cca-4e13-bc19-1f20525273c2 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:55.353553 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1e0fd6b6-9cca-4e13-bc19-1f20525273c2 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:55.353987 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1e0fd6b6-9cca-4e13-bc19-1f20525273c2 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:55.503101 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1e0fd6b6-9cca-4e13-bc19-1f20525273c2 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:55.511309 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1e0fd6b6-9cca-4e13-bc19-1f20525273c2 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1278 microversion: 2.1 time: 0.170200 Jun 16 00:41:55.511894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 561/1141] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:55 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:56.528696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7265a360-e442-4dbd-8359-ae7cf9fbc3ed tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:56.529296 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7265a360-e442-4dbd-8359-ae7cf9fbc3ed tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:56.535157 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7265a360-e442-4dbd-8359-ae7cf9fbc3ed tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:56.535594 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7265a360-e442-4dbd-8359-ae7cf9fbc3ed tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:56.536380 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7265a360-e442-4dbd-8359-ae7cf9fbc3ed tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:56.536814 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7265a360-e442-4dbd-8359-ae7cf9fbc3ed tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:56.669088 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7265a360-e442-4dbd-8359-ae7cf9fbc3ed tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:56.676413 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7265a360-e442-4dbd-8359-ae7cf9fbc3ed tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1266 microversion: 2.1 time: 0.152036 Jun 16 00:41:56.676974 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 581/1142] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:56 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:57.694565 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-1cc2bbc0-6ace-4c86-a556-f8ebe07712c7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:57.695176 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-1cc2bbc0-6ace-4c86-a556-f8ebe07712c7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:57.702554 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1cc2bbc0-6ace-4c86-a556-f8ebe07712c7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:57.703050 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1cc2bbc0-6ace-4c86-a556-f8ebe07712c7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:57.703920 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1cc2bbc0-6ace-4c86-a556-f8ebe07712c7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:57.704526 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-1cc2bbc0-6ace-4c86-a556-f8ebe07712c7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:57.834705 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-1cc2bbc0-6ace-4c86-a556-f8ebe07712c7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:57.842681 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-1cc2bbc0-6ace-4c86-a556-f8ebe07712c7 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1266 microversion: 2.1 time: 0.152932 Jun 16 00:41:57.843231 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 562/1143] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:57 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:58.859817 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4410476f-05f4-4b40-bf33-9c221f71c461 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:58.860428 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4410476f-05f4-4b40-bf33-9c221f71c461 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:58.867485 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4410476f-05f4-4b40-bf33-9c221f71c461 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:58.867973 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4410476f-05f4-4b40-bf33-9c221f71c461 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:58.868738 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4410476f-05f4-4b40-bf33-9c221f71c461 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:58.869177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4410476f-05f4-4b40-bf33-9c221f71c461 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:59.000350 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4410476f-05f4-4b40-bf33-9c221f71c461 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:59.008058 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4410476f-05f4-4b40-bf33-9c221f71c461 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1266 microversion: 2.1 time: 0.151976 Jun 16 00:41:59.008617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 582/1144] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:58 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:00.024571 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3d25e493-b307-4d6a-89b1-cbfd72e72129 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:00.025120 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3d25e493-b307-4d6a-89b1-cbfd72e72129 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:00.027831 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:00.028494 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=6 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:00.034777 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3d25e493-b307-4d6a-89b1-cbfd72e72129 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:00.035235 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3d25e493-b307-4d6a-89b1-cbfd72e72129 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:00.036106 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3d25e493-b307-4d6a-89b1-cbfd72e72129 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:00.036542 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3d25e493-b307-4d6a-89b1-cbfd72e72129 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:00.171200 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3d25e493-b307-4d6a-89b1-cbfd72e72129 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:00.178659 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3d25e493-b307-4d6a-89b1-cbfd72e72129 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1266 microversion: 2.1 time: 0.158007 Jun 16 00:42:00.179782 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 563/1145] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:00 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:01.196448 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4591a893-dd96-4987-8ba9-7fc68c209f3e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:01.197156 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4591a893-dd96-4987-8ba9-7fc68c209f3e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:01.199054 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:01.204821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4591a893-dd96-4987-8ba9-7fc68c209f3e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:01.205268 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4591a893-dd96-4987-8ba9-7fc68c209f3e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:01.206036 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4591a893-dd96-4987-8ba9-7fc68c209f3e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:01.206470 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4591a893-dd96-4987-8ba9-7fc68c209f3e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:01.345954 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4591a893-dd96-4987-8ba9-7fc68c209f3e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:01.354296 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4591a893-dd96-4987-8ba9-7fc68c209f3e tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1266 microversion: 2.1 time: 0.162220 Jun 16 00:42:01.355174 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 583/1146] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:01 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:02.370590 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0e582a7f-86a9-42f2-acab-8a0366d1adfd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:02.371205 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0e582a7f-86a9-42f2-acab-8a0366d1adfd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:02.377670 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0e582a7f-86a9-42f2-acab-8a0366d1adfd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:02.378154 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0e582a7f-86a9-42f2-acab-8a0366d1adfd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:02.378940 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0e582a7f-86a9-42f2-acab-8a0366d1adfd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:02.379377 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0e582a7f-86a9-42f2-acab-8a0366d1adfd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:02.520222 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0e582a7f-86a9-42f2-acab-8a0366d1adfd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:02.528056 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0e582a7f-86a9-42f2-acab-8a0366d1adfd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1266 microversion: 2.1 time: 0.161733 Jun 16 00:42:02.528867 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 564/1147] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:02 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:03.544943 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-55da0c3f-90b2-4778-92d3-e7a68d6ca8d3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:03.545552 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-55da0c3f-90b2-4778-92d3-e7a68d6ca8d3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:03.552005 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-55da0c3f-90b2-4778-92d3-e7a68d6ca8d3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:03.552455 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-55da0c3f-90b2-4778-92d3-e7a68d6ca8d3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:03.553239 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-55da0c3f-90b2-4778-92d3-e7a68d6ca8d3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:03.554231 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-55da0c3f-90b2-4778-92d3-e7a68d6ca8d3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:03.685831 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-55da0c3f-90b2-4778-92d3-e7a68d6ca8d3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:03.695539 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-55da0c3f-90b2-4778-92d3-e7a68d6ca8d3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1266 microversion: 2.1 time: 0.153981 Jun 16 00:42:03.697018 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 584/1148] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:03 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:04.712944 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-f3151d83-9440-4e8f-83f9-61ecec5ac5a5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:04.714108 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-f3151d83-9440-4e8f-83f9-61ecec5ac5a5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:04.722712 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f3151d83-9440-4e8f-83f9-61ecec5ac5a5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:04.723224 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f3151d83-9440-4e8f-83f9-61ecec5ac5a5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:04.724194 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f3151d83-9440-4e8f-83f9-61ecec5ac5a5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:04.724741 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-f3151d83-9440-4e8f-83f9-61ecec5ac5a5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:04.871976 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-f3151d83-9440-4e8f-83f9-61ecec5ac5a5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:04.879349 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-f3151d83-9440-4e8f-83f9-61ecec5ac5a5 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1266 microversion: 2.1 time: 0.170448 Jun 16 00:42:04.880145 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 565/1149] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:04 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:05.897060 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-87f158c0-1820-479a-b877-b26113b01868 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:05.898224 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-87f158c0-1820-479a-b877-b26113b01868 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:05.904652 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-87f158c0-1820-479a-b877-b26113b01868 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:05.905120 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-87f158c0-1820-479a-b877-b26113b01868 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:05.906269 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-87f158c0-1820-479a-b877-b26113b01868 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:05.906399 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-87f158c0-1820-479a-b877-b26113b01868 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:06.041499 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-87f158c0-1820-479a-b877-b26113b01868 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:06.048898 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-87f158c0-1820-479a-b877-b26113b01868 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1266 microversion: 2.1 time: 0.155684 Jun 16 00:42:06.049455 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 585/1150] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:05 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:06.962290 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-394290fa-e76c-4fdf-864e-b22164eea488 req-90a186f2-0e71-4108-9cb8-8c1845b22879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ca7fdf2-0f00-4e8a-9521-98dcd57c5219", "name": "network-vif-plugged", "status": "completed", "tag": "26f5e2a7-f5fa-4003-a9df-46464649afd5"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:06.974208 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:06.978138 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-394290fa-e76c-4fdf-864e-b22164eea488 req-90a186f2-0e71-4108-9cb8-8c1845b22879 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:06.978894 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-394290fa-e76c-4fdf-864e-b22164eea488 req-90a186f2-0e71-4108-9cb8-8c1845b22879 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:06.998465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-394290fa-e76c-4fdf-864e-b22164eea488 req-90a186f2-0e71-4108-9cb8-8c1845b22879 service nova] Creating event network-vif-plugged:26f5e2a7-f5fa-4003-a9df-46464649afd5 for instance 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 on hv-cinder-84327 Jun 16 00:42:07.005179 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-394290fa-e76c-4fdf-864e-b22164eea488 req-90a186f2-0e71-4108-9cb8-8c1845b22879 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048148 Jun 16 00:42:07.005776 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 566/1151] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:07.067354 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e939e1f3-3323-4209-a211-38cd237f5db9 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:07.069600 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e939e1f3-3323-4209-a211-38cd237f5db9 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:07.076935 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e939e1f3-3323-4209-a211-38cd237f5db9 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:07.078099 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e939e1f3-3323-4209-a211-38cd237f5db9 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:07.079319 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e939e1f3-3323-4209-a211-38cd237f5db9 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:07.079982 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e939e1f3-3323-4209-a211-38cd237f5db9 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:07.239850 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-e939e1f3-3323-4209-a211-38cd237f5db9 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:07.249637 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e939e1f3-3323-4209-a211-38cd237f5db9 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1266 microversion: 2.1 time: 0.186915 Jun 16 00:42:07.250621 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 586/1152] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:07 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:08.267547 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a890ad1a-5bc6-43a2-a83f-6e75bdf63fac tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:08.268254 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a890ad1a-5bc6-43a2-a83f-6e75bdf63fac tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:08.275186 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a890ad1a-5bc6-43a2-a83f-6e75bdf63fac tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:08.275651 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a890ad1a-5bc6-43a2-a83f-6e75bdf63fac tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:08.276446 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a890ad1a-5bc6-43a2-a83f-6e75bdf63fac tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:08.276881 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a890ad1a-5bc6-43a2-a83f-6e75bdf63fac tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:08.279526 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:08.405024 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a890ad1a-5bc6-43a2-a83f-6e75bdf63fac tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:08.412493 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a890ad1a-5bc6-43a2-a83f-6e75bdf63fac tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1266 microversion: 2.1 time: 0.149622 Jun 16 00:42:08.413633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 567/1153] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:08 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:08.489376 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1233737228", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "networks": [{"uuid": "f0211a58-6976-4417-a513-fd7625799499"}]}} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:08.540148 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.network.neutron [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] validate_networks() for [('f0211a58-6976-4417-a513-fd7625799499', None, None, None, None, None)] {{(pid=129466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:42:08.875660 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Flavor limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:42:08.876089 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Image limits 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:42:08.876569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Flavor pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:42:08.877103 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Image pref 0:0:0 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:42:08.877529 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.virt.hardware [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:42:08.887081 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:08.887538 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:08.888401 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:08.888840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:08.906111 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Getting quotas for project ff8a376cc31445ee913739e0d2e8eec2. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:42:08.909995 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.quota [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Getting quotas for user 19a40d49410041928eb9ac2e14206c02 and project ff8a376cc31445ee913739e0d2e8eec2. Resources: {'cores', 'instances', 'ram'} {{(pid=129466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:42:08.920778 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Going to run 1 instances... {{(pid=129466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:42:08.922980 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:42:08.969205 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d43c3e92-574f-4d31-8afd-afa2aa6a06f5 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483595 Jun 16 00:42:08.969984 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 587/1154] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:42:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:42:08.979997 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-98763d9b-8ddb-4346-81fe-3481e5248d84 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:08.980604 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-98763d9b-8ddb-4346-81fe-3481e5248d84 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:09.040835 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-98763d9b-8ddb-4346-81fe-3481e5248d84 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:09.047533 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-98763d9b-8ddb-4346-81fe-3481e5248d84 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1219 microversion: 2.1 time: 0.071335 Jun 16 00:42:09.048120 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 568/1155] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:08 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:09.430549 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-672e5d6b-7160-4882-aad5-24574edc2228 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:09.431107 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-672e5d6b-7160-4882-aad5-24574edc2228 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:09.437183 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-672e5d6b-7160-4882-aad5-24574edc2228 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:09.437633 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-672e5d6b-7160-4882-aad5-24574edc2228 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:09.438398 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-672e5d6b-7160-4882-aad5-24574edc2228 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:09.438835 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-672e5d6b-7160-4882-aad5-24574edc2228 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:09.574865 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-672e5d6b-7160-4882-aad5-24574edc2228 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:09.582381 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-672e5d6b-7160-4882-aad5-24574edc2228 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1452 microversion: 2.1 time: 0.156488 Jun 16 00:42:09.582946 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 588/1156] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:09 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:09.598144 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-baa568ef-69c3-4cf5-8d7f-d37352af47d4 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:09.598755 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-baa568ef-69c3-4cf5-8d7f-d37352af47d4 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:09.606154 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-baa568ef-69c3-4cf5-8d7f-d37352af47d4 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:09.606606 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-baa568ef-69c3-4cf5-8d7f-d37352af47d4 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:09.607365 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-baa568ef-69c3-4cf5-8d7f-d37352af47d4 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:09.607836 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-baa568ef-69c3-4cf5-8d7f-d37352af47d4 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:09.738156 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-baa568ef-69c3-4cf5-8d7f-d37352af47d4 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:09.745595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-baa568ef-69c3-4cf5-8d7f-d37352af47d4 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1452 microversion: 2.1 time: 0.151315 Jun 16 00:42:09.746153 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 569/1157] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:09 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:10.065195 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-fa96b095-2082-4885-914d-393a6826d83c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:10.065874 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-fa96b095-2082-4885-914d-393a6826d83c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:10.077060 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fa96b095-2082-4885-914d-393a6826d83c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:10.077817 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fa96b095-2082-4885-914d-393a6826d83c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:10.078765 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fa96b095-2082-4885-914d-393a6826d83c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:10.079366 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-fa96b095-2082-4885-914d-393a6826d83c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:10.166632 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-fa96b095-2082-4885-914d-393a6826d83c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:10.174706 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-fa96b095-2082-4885-914d-393a6826d83c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1277 microversion: 2.1 time: 0.113413 Jun 16 00:42:10.175277 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 589/1158] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:10 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:42:11.192077 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c7f28fd0-a451-4b05-bbf2-6668f51db56c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:11.192853 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c7f28fd0-a451-4b05-bbf2-6668f51db56c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:11.200210 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c7f28fd0-a451-4b05-bbf2-6668f51db56c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:11.201007 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c7f28fd0-a451-4b05-bbf2-6668f51db56c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:11.201906 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c7f28fd0-a451-4b05-bbf2-6668f51db56c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:11.202471 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c7f28fd0-a451-4b05-bbf2-6668f51db56c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:11.429636 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c7f28fd0-a451-4b05-bbf2-6668f51db56c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:11.437516 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c7f28fd0-a451-4b05-bbf2-6668f51db56c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1319 microversion: 2.1 time: 0.249439 Jun 16 00:42:11.438087 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 570/1159] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:11 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:11.536459 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-d3996836-93fc-4c5e-936e-5647914c2cc7 req-cf8aeb4e-4c09-4a2e-b4d0-0c284e293b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ade7bdc-c56c-4f09-83db-94f30a5c6f4b", "tag": "dcf43c98-685a-4233-94cc-37ed467f35ef"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:11.547131 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-d3996836-93fc-4c5e-936e-5647914c2cc7 req-cf8aeb4e-4c09-4a2e-b4d0-0c284e293b08 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:11.547781 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-d3996836-93fc-4c5e-936e-5647914c2cc7 req-cf8aeb4e-4c09-4a2e-b4d0-0c284e293b08 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:11.560947 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-d3996836-93fc-4c5e-936e-5647914c2cc7 req-cf8aeb4e-4c09-4a2e-b4d0-0c284e293b08 service nova] Creating event network-changed:dcf43c98-685a-4233-94cc-37ed467f35ef for instance 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b on hv-cinder-84327 Jun 16 00:42:11.567373 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-d3996836-93fc-4c5e-936e-5647914c2cc7 req-cf8aeb4e-4c09-4a2e-b4d0-0c284e293b08 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037702 Jun 16 00:42:11.568263 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 590/1160] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:11.743168 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-9e78f181-1735-4c1a-b3e0-ace69f1691d6 req-76c1e1de-c0b2-4b95-a9b8-0cf65e02d934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ca7fdf2-0f00-4e8a-9521-98dcd57c5219", "tag": "26f5e2a7-f5fa-4003-a9df-46464649afd5"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:11.751332 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-9e78f181-1735-4c1a-b3e0-ace69f1691d6 req-76c1e1de-c0b2-4b95-a9b8-0cf65e02d934 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:11.752325 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-9e78f181-1735-4c1a-b3e0-ace69f1691d6 req-76c1e1de-c0b2-4b95-a9b8-0cf65e02d934 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:11.764539 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-9e78f181-1735-4c1a-b3e0-ace69f1691d6 req-76c1e1de-c0b2-4b95-a9b8-0cf65e02d934 service nova] Creating event network-changed:26f5e2a7-f5fa-4003-a9df-46464649afd5 for instance 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 on hv-cinder-84327 Jun 16 00:42:11.769745 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-9e78f181-1735-4c1a-b3e0-ace69f1691d6 req-76c1e1de-c0b2-4b95-a9b8-0cf65e02d934 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031235 Jun 16 00:42:11.770471 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 571/1161] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:12.455089 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d977ba3a-e9d4-4b34-a7f1-09136d08164f tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:12.455839 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d977ba3a-e9d4-4b34-a7f1-09136d08164f tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:12.462963 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d977ba3a-e9d4-4b34-a7f1-09136d08164f tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:12.463404 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d977ba3a-e9d4-4b34-a7f1-09136d08164f tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:12.464382 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d977ba3a-e9d4-4b34-a7f1-09136d08164f tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:12.464814 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d977ba3a-e9d4-4b34-a7f1-09136d08164f tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:12.600030 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d977ba3a-e9d4-4b34-a7f1-09136d08164f tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:12.607792 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d977ba3a-e9d4-4b34-a7f1-09136d08164f tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1319 microversion: 2.1 time: 0.157014 Jun 16 00:42:12.608644 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 591/1162] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:12 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:13.625808 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0ce3aa0c-515c-4920-aae0-714b46ef2ef3 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:13.627047 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0ce3aa0c-515c-4920-aae0-714b46ef2ef3 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:13.633892 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0ce3aa0c-515c-4920-aae0-714b46ef2ef3 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:13.634342 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0ce3aa0c-515c-4920-aae0-714b46ef2ef3 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:13.635352 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0ce3aa0c-515c-4920-aae0-714b46ef2ef3 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:13.635829 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0ce3aa0c-515c-4920-aae0-714b46ef2ef3 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:13.767997 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0ce3aa0c-515c-4920-aae0-714b46ef2ef3 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:13.775348 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0ce3aa0c-515c-4920-aae0-714b46ef2ef3 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1319 microversion: 2.1 time: 0.154295 Jun 16 00:42:13.775941 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 572/1163] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:13 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:14.792132 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c208ffb4-d297-4782-8959-e6cb11b9289c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:14.792746 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c208ffb4-d297-4782-8959-e6cb11b9289c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:14.799627 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c208ffb4-d297-4782-8959-e6cb11b9289c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:14.800292 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c208ffb4-d297-4782-8959-e6cb11b9289c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:14.801075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c208ffb4-d297-4782-8959-e6cb11b9289c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:14.801711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c208ffb4-d297-4782-8959-e6cb11b9289c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:14.933265 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c208ffb4-d297-4782-8959-e6cb11b9289c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:14.940572 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c208ffb4-d297-4782-8959-e6cb11b9289c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1319 microversion: 2.1 time: 0.152301 Jun 16 00:42:14.941124 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 592/1164] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:14 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:15.957613 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-33d40a1e-3958-46ef-a3cf-ec1a39fdf381 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:15.958249 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-33d40a1e-3958-46ef-a3cf-ec1a39fdf381 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:15.965513 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-33d40a1e-3958-46ef-a3cf-ec1a39fdf381 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:15.965959 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-33d40a1e-3958-46ef-a3cf-ec1a39fdf381 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:15.966717 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-33d40a1e-3958-46ef-a3cf-ec1a39fdf381 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:15.967158 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-33d40a1e-3958-46ef-a3cf-ec1a39fdf381 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:16.091303 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-33d40a1e-3958-46ef-a3cf-ec1a39fdf381 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:16.098567 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-33d40a1e-3958-46ef-a3cf-ec1a39fdf381 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1319 microversion: 2.1 time: 0.144763 Jun 16 00:42:16.099133 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 573/1165] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:15 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:17.115779 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d7533c31-eedf-41e2-a316-5c38e6ad602c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:17.116406 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d7533c31-eedf-41e2-a316-5c38e6ad602c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:17.118853 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:17.124674 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d7533c31-eedf-41e2-a316-5c38e6ad602c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:17.125130 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d7533c31-eedf-41e2-a316-5c38e6ad602c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:17.125902 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d7533c31-eedf-41e2-a316-5c38e6ad602c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:17.126345 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d7533c31-eedf-41e2-a316-5c38e6ad602c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:17.130783 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=90 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:17.258967 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d7533c31-eedf-41e2-a316-5c38e6ad602c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:17.267070 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d7533c31-eedf-41e2-a316-5c38e6ad602c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1319 microversion: 2.1 time: 0.155611 Jun 16 00:42:17.267641 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 593/1166] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:17 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:42:18.283372 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-b93ac348-a4c9-483e-a315-02e2073a30fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:18.284007 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-b93ac348-a4c9-483e-a315-02e2073a30fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:18.291370 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b93ac348-a4c9-483e-a315-02e2073a30fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:18.291859 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b93ac348-a4c9-483e-a315-02e2073a30fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:18.292620 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b93ac348-a4c9-483e-a315-02e2073a30fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:18.293053 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-b93ac348-a4c9-483e-a315-02e2073a30fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:18.420434 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-b93ac348-a4c9-483e-a315-02e2073a30fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:18.427679 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-b93ac348-a4c9-483e-a315-02e2073a30fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1319 microversion: 2.1 time: 0.148096 Jun 16 00:42:18.428494 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 574/1167] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:18 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:18.712159 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-a69614c9-5a59-408e-9a2b-506d666deabb req-0d6b2317-6e5b-405d-a9b2-5f52fc7bf71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ade7bdc-c56c-4f09-83db-94f30a5c6f4b", "name": "network-vif-plugged", "status": "completed", "tag": "dcf43c98-685a-4233-94cc-37ed467f35ef"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:18.723724 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-a69614c9-5a59-408e-9a2b-506d666deabb req-0d6b2317-6e5b-405d-a9b2-5f52fc7bf71e service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:18.724437 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-a69614c9-5a59-408e-9a2b-506d666deabb req-0d6b2317-6e5b-405d-a9b2-5f52fc7bf71e service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:18.735646 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-a69614c9-5a59-408e-9a2b-506d666deabb req-0d6b2317-6e5b-405d-a9b2-5f52fc7bf71e service nova] Creating event network-vif-plugged:dcf43c98-685a-4233-94cc-37ed467f35ef for instance 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b on hv-cinder-84327 Jun 16 00:42:18.741299 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-a69614c9-5a59-408e-9a2b-506d666deabb req-0d6b2317-6e5b-405d-a9b2-5f52fc7bf71e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032683 Jun 16 00:42:18.741889 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 594/1168] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:19.445557 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5eae386c-4577-4de1-b389-6295152590fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:19.446172 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5eae386c-4577-4de1-b389-6295152590fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:19.448143 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:19.453805 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5eae386c-4577-4de1-b389-6295152590fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:19.454260 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5eae386c-4577-4de1-b389-6295152590fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:19.455027 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5eae386c-4577-4de1-b389-6295152590fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:19.455470 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5eae386c-4577-4de1-b389-6295152590fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:19.583458 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5eae386c-4577-4de1-b389-6295152590fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:19.591294 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5eae386c-4577-4de1-b389-6295152590fe tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1319 microversion: 2.1 time: 0.149609 Jun 16 00:42:19.591876 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 575/1169] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:19 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:20.608681 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-63136a75-71c7-42cc-bbf5-7824778d9885 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:20.609369 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-63136a75-71c7-42cc-bbf5-7824778d9885 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:20.611284 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:20.612092 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=6 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:20.619236 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63136a75-71c7-42cc-bbf5-7824778d9885 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:20.619727 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63136a75-71c7-42cc-bbf5-7824778d9885 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:20.620487 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63136a75-71c7-42cc-bbf5-7824778d9885 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:20.620916 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-63136a75-71c7-42cc-bbf5-7824778d9885 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:20.749073 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-63136a75-71c7-42cc-bbf5-7824778d9885 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:20.756449 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-63136a75-71c7-42cc-bbf5-7824778d9885 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1507 microversion: 2.1 time: 0.151937 Jun 16 00:42:20.757004 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 595/1170] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:20 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:44.240069 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-09655fad-91f1-4fe2-8ee8-0da10f150f88 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8aedd169-4e1a-4c6a-b430-50f969210656", "device": "/dev/sdb"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:44.241622 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-09655fad-91f1-4fe2-8ee8-0da10f150f88 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:44.243585 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=21 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:44.244306 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=43 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:44.250160 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-09655fad-91f1-4fe2-8ee8-0da10f150f88 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:44.250609 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-09655fad-91f1-4fe2-8ee8-0da10f150f88 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:44.251373 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-09655fad-91f1-4fe2-8ee8-0da10f150f88 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:44.251848 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-09655fad-91f1-4fe2-8ee8-0da10f150f88 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:44.499431 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-09655fad-91f1-4fe2-8ee8-0da10f150f88 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "POST /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263307 Jun 16 00:42:44.500225 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 576/1171] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:42:44 2022] POST /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:43:11.169887 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1f04c632-d2af-4b63-9ed3-0f9a01bcb064 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:11.170455 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1f04c632-d2af-4b63-9ed3-0f9a01bcb064 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:11.172458 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=5 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:11.173204 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=13 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:11.179680 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1f04c632-d2af-4b63-9ed3-0f9a01bcb064 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:11.180136 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1f04c632-d2af-4b63-9ed3-0f9a01bcb064 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:11.180935 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1f04c632-d2af-4b63-9ed3-0f9a01bcb064 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:11.181376 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1f04c632-d2af-4b63-9ed3-0f9a01bcb064 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:11.263249 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.objects.instance [None req-1f04c632-d2af-4b63-9ed3-0f9a01bcb064 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lazy-loading 'services' on Instance uuid 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b {{(pid=129466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:43:11.334789 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1f04c632-d2af-4b63-9ed3-0f9a01bcb064 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b/os-volume_attachments/8aedd169-4e1a-4c6a-b430-50f969210656" status: 202 len: 0 microversion: 2.1 time: 0.168675 Jun 16 00:43:11.335404 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 596/1172] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 16 00:43:11 2022] DELETE /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b/os-volume_attachments/8aedd169-4e1a-4c6a-b430-50f969210656 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:43:12.449086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3fcad318-f13f-4af8-9082-1df3c6b0afb8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:12.449669 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3fcad318-f13f-4af8-9082-1df3c6b0afb8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:12.452226 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:12.452890 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:12.459275 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3fcad318-f13f-4af8-9082-1df3c6b0afb8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:12.459748 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3fcad318-f13f-4af8-9082-1df3c6b0afb8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:12.460512 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3fcad318-f13f-4af8-9082-1df3c6b0afb8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:12.460949 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3fcad318-f13f-4af8-9082-1df3c6b0afb8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:12.490117 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3fcad318-f13f-4af8-9082-1df3c6b0afb8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Going to try to terminate instance {{(pid=129465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:43:12.567441 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3fcad318-f13f-4af8-9082-1df3c6b0afb8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 204 len: 0 microversion: 2.1 time: 0.121879 Jun 16 00:43:12.568356 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 577/1173] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:43:12 2022] DELETE /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 00:43:12.578108 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1c8a9ab7-f902-4d34-bdc2-474d8645930b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:12.578805 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1c8a9ab7-f902-4d34-bdc2-474d8645930b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:12.585609 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1c8a9ab7-f902-4d34-bdc2-474d8645930b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:12.586056 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1c8a9ab7-f902-4d34-bdc2-474d8645930b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:12.586849 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1c8a9ab7-f902-4d34-bdc2-474d8645930b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:12.587286 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1c8a9ab7-f902-4d34-bdc2-474d8645930b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:12.718827 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-1c8a9ab7-f902-4d34-bdc2-474d8645930b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:12.726966 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1c8a9ab7-f902-4d34-bdc2-474d8645930b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1513 microversion: 2.1 time: 0.153792 Jun 16 00:43:12.727536 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 597/1174] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:12 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:13.745036 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a99fafa1-a172-47f8-9cf8-3f4e96de2a28 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:13.745737 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a99fafa1-a172-47f8-9cf8-3f4e96de2a28 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:13.752088 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a99fafa1-a172-47f8-9cf8-3f4e96de2a28 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:13.752533 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a99fafa1-a172-47f8-9cf8-3f4e96de2a28 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:13.753898 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a99fafa1-a172-47f8-9cf8-3f4e96de2a28 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:13.754332 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a99fafa1-a172-47f8-9cf8-3f4e96de2a28 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:13.882811 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a99fafa1-a172-47f8-9cf8-3f4e96de2a28 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:13.890168 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a99fafa1-a172-47f8-9cf8-3f4e96de2a28 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1513 microversion: 2.1 time: 0.149335 Jun 16 00:43:13.890718 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 578/1175] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:13 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:14.906749 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-7221583d-6d68-41f9-aa17-deb6a54f9daa tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:14.907362 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-7221583d-6d68-41f9-aa17-deb6a54f9daa tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:14.914156 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7221583d-6d68-41f9-aa17-deb6a54f9daa tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:14.914557 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7221583d-6d68-41f9-aa17-deb6a54f9daa tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:14.915322 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7221583d-6d68-41f9-aa17-deb6a54f9daa tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:14.915806 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-7221583d-6d68-41f9-aa17-deb6a54f9daa tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:15.047117 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-7221583d-6d68-41f9-aa17-deb6a54f9daa tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:15.054569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-7221583d-6d68-41f9-aa17-deb6a54f9daa tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 200 len: 1513 microversion: 2.1 time: 0.151609 Jun 16 00:43:15.055134 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 598/1176] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:14 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:15.134888 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-a3e2681c-061b-4c70-8f92-132f4b034114 req-f4be3d7a-0de1-4706-8cb4-32866d953733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ade7bdc-c56c-4f09-83db-94f30a5c6f4b", "name": "network-vif-deleted", "tag": "dcf43c98-685a-4233-94cc-37ed467f35ef"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:43:15.144439 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-a3e2681c-061b-4c70-8f92-132f4b034114 req-f4be3d7a-0de1-4706-8cb4-32866d953733 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:15.144880 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-a3e2681c-061b-4c70-8f92-132f4b034114 req-f4be3d7a-0de1-4706-8cb4-32866d953733 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:15.155653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-a3e2681c-061b-4c70-8f92-132f4b034114 req-f4be3d7a-0de1-4706-8cb4-32866d953733 service nova] Creating event network-vif-deleted:dcf43c98-685a-4233-94cc-37ed467f35ef for instance 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b on hv-cinder-84327 Jun 16 00:43:15.161001 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-a3e2681c-061b-4c70-8f92-132f4b034114 req-f4be3d7a-0de1-4706-8cb4-32866d953733 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029864 Jun 16 00:43:15.161680 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 579/1177] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:43:16.072144 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e21ba7fd-60b7-445e-b164-475242283351 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:16.072697 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-e21ba7fd-60b7-445e-b164-475242283351 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:16.079122 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e21ba7fd-60b7-445e-b164-475242283351 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:16.079570 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e21ba7fd-60b7-445e-b164-475242283351 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:16.080366 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e21ba7fd-60b7-445e-b164-475242283351 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:16.080805 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-e21ba7fd-60b7-445e-b164-475242283351 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:16.093718 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-e21ba7fd-60b7-445e-b164-475242283351 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] HTTP exception thrown: Instance 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b could not be found. Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e21ba7fd-60b7-445e-b164-475242283351 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Request method failure captured: Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b HTTP/1.1 Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnxeYwBcSXQ995tjs3AzRIe4pXbdn4iHzBnoTzqZVmWnmtp0K0fYyG9LPZ7lsWFFv94Wns-BzpK6MyvIW7Of6mNYrbgWVtCTsdYpBSwHV44zxoHW-dj-cBxlIyEEhhwH5u_FaJlapQL3B1BqP3bwOOmM8CgsBdjVMr_czfBXMeWpEUY Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: ff8a376cc31445ee913739e0d2e8eec2 Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1162408786 Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:43:16.095334 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:43:16.097695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ff8a376cc31445ee913739e0d2e8eec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ff8a376cc31445ee913739e0d2e8eec2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ff8a376cc31445ee913739e0d2e8eec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ff8a376cc31445ee913739e0d2e8eec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:43:16.097695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-VolumesSnapshotTestJSON-1162408786 Jun 16 00:43:16.097695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: ff8a376cc31445ee913739e0d2e8eec2 Jun 16 00:43:16.097695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1162408786 Jun 16 00:43:16.097695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-VolumesSnapshotTestJSON-1162408786-project Jun 16 00:43:16.097695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:43:16.097695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:43:16.097695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: 19a40d49410041928eb9ac2e14206c02 Jun 16 00:43:16.097695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-VolumesSnapshotTestJSON-1162408786-project Jun 16 00:43:16.097695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:43:16.097695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b could not be found. Jun 16 00:43:16.097695 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': '6ade7bdc-c56c-4f09-83db-94f30a5c6f4b'} Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b could not be found. Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:43:16.098821 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b could not be found. Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b could not be found. Jun 16 00:43:16.100677 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:43:16.102210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-e21ba7fd-60b7-445e-b164-475242283351 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Returning 404 to user: Instance 6ade7bdc-c56c-4f09-83db-94f30a5c6f4b could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:43:16.102210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-e21ba7fd-60b7-445e-b164-475242283351 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b" status: 404 len: 111 microversion: 2.1 time: 0.028532 Jun 16 00:43:16.102210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 599/1178] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:16 2022] GET /compute/v2.1/servers/6ade7bdc-c56c-4f09-83db-94f30a5c6f4b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:43:25.885809 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:25.886621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:25.890606 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1533756380", "imageRef": "d36c2144-f571-4aa9-a31f-d59d62ac7322", "flavorRef": "452", "networks": [{"uuid": "f0211a58-6976-4417-a513-fd7625799499"}]}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:43:25.942332 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] validate_networks() for [('f0211a58-6976-4417-a513-fd7625799499', None, None, None, None, None)] {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:43:26.274521 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:43:26.274941 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:43:26.275408 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:43:26.275847 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:43:26.276282 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:43:26.285088 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:26.285535 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:26.286335 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:26.286767 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:26.303696 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Getting quotas for project ff8a376cc31445ee913739e0d2e8eec2. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:43:26.307583 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Getting quotas for user 19a40d49410041928eb9ac2e14206c02 and project ff8a376cc31445ee913739e0d2e8eec2. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:43:26.319016 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:43:26.321286 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d36c2144-f571-4aa9-a31f-d59d62ac7322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:43:26.364062 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-89c8dd18-4789-4015-99d2-ee33191830a7 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.479681 Jun 16 00:43:26.364695 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 580/1179] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:43:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:43:26.374563 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ab60ae15-49f8-400a-a454-1ad7c1c3a45f tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:26.375210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ab60ae15-49f8-400a-a454-1ad7c1c3a45f tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:26.378413 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=8 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:26.380092 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:26.437078 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ab60ae15-49f8-400a-a454-1ad7c1c3a45f tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:26.445199 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ab60ae15-49f8-400a-a454-1ad7c1c3a45f tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1219 microversion: 2.1 time: 0.074438 Jun 16 00:43:26.445749 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 600/1180] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:26 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:27.463385 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-bb7ff398-b24b-4fcd-b073-8f88c58dca2c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:27.464027 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-bb7ff398-b24b-4fcd-b073-8f88c58dca2c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:27.470368 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb7ff398-b24b-4fcd-b073-8f88c58dca2c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:27.470820 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb7ff398-b24b-4fcd-b073-8f88c58dca2c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:27.471592 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb7ff398-b24b-4fcd-b073-8f88c58dca2c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:27.472057 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-bb7ff398-b24b-4fcd-b073-8f88c58dca2c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:27.537053 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-bb7ff398-b24b-4fcd-b073-8f88c58dca2c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:27.544497 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-bb7ff398-b24b-4fcd-b073-8f88c58dca2c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1277 microversion: 2.1 time: 0.085647 Jun 16 00:43:27.545134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 581/1181] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:27 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:28.561351 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d0f289f2-db7f-418e-ab6f-8cb764791db8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:28.561981 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d0f289f2-db7f-418e-ab6f-8cb764791db8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:28.568606 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d0f289f2-db7f-418e-ab6f-8cb764791db8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:28.569058 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d0f289f2-db7f-418e-ab6f-8cb764791db8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:28.569831 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d0f289f2-db7f-418e-ab6f-8cb764791db8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:28.570262 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d0f289f2-db7f-418e-ab6f-8cb764791db8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:28.601120 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-49da67e9-cfa7-478a-9c60-eaddbaae7b64 req-08e4110d-9b59-4ef6-9df0-36c32a8a4d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9308ad-1dba-4dbb-a4b0-439e3d236d43", "tag": "13a2e6ce-284c-4328-9986-6e67e531a2e9"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:43:28.610961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-49da67e9-cfa7-478a-9c60-eaddbaae7b64 req-08e4110d-9b59-4ef6-9df0-36c32a8a4d33 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:28.611364 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-49da67e9-cfa7-478a-9c60-eaddbaae7b64 req-08e4110d-9b59-4ef6-9df0-36c32a8a4d33 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:28.623151 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-49da67e9-cfa7-478a-9c60-eaddbaae7b64 req-08e4110d-9b59-4ef6-9df0-36c32a8a4d33 service nova] Creating event network-changed:13a2e6ce-284c-4328-9986-6e67e531a2e9 for instance ae9308ad-1dba-4dbb-a4b0-439e3d236d43 on hv-cinder-84327 Jun 16 00:43:28.628088 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-49da67e9-cfa7-478a-9c60-eaddbaae7b64 req-08e4110d-9b59-4ef6-9df0-36c32a8a4d33 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030767 Jun 16 00:43:28.628985 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 582/1182] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:43:28.720642 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d0f289f2-db7f-418e-ab6f-8cb764791db8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:28.728938 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d0f289f2-db7f-418e-ab6f-8cb764791db8 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1319 microversion: 2.1 time: 0.171505 Jun 16 00:43:28.729502 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 601/1183] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:28 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:29.746277 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-d778eca1-f59b-40d1-b7de-d32d72a69766 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:29.746980 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-d778eca1-f59b-40d1-b7de-d32d72a69766 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:29.753226 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d778eca1-f59b-40d1-b7de-d32d72a69766 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:29.753681 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d778eca1-f59b-40d1-b7de-d32d72a69766 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:29.754446 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d778eca1-f59b-40d1-b7de-d32d72a69766 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:29.754882 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-d778eca1-f59b-40d1-b7de-d32d72a69766 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:29.883426 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-d778eca1-f59b-40d1-b7de-d32d72a69766 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:29.890782 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-d778eca1-f59b-40d1-b7de-d32d72a69766 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1319 microversion: 2.1 time: 0.149155 Jun 16 00:43:29.891343 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 583/1184] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:29 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:30.907393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ade61183-3032-480e-8509-20219f5f7265 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:30.908020 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ade61183-3032-480e-8509-20219f5f7265 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:30.914440 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ade61183-3032-480e-8509-20219f5f7265 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:30.914884 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ade61183-3032-480e-8509-20219f5f7265 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:30.915678 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ade61183-3032-480e-8509-20219f5f7265 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:30.916112 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ade61183-3032-480e-8509-20219f5f7265 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:31.041322 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-ade61183-3032-480e-8509-20219f5f7265 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:31.048625 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ade61183-3032-480e-8509-20219f5f7265 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1319 microversion: 2.1 time: 0.145117 Jun 16 00:43:31.049794 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 602/1185] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:30 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:32.066581 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-5eaca102-d99f-4fe8-b952-7d6551452ac6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:32.067187 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-5eaca102-d99f-4fe8-b952-7d6551452ac6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:32.073582 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5eaca102-d99f-4fe8-b952-7d6551452ac6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:32.074027 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5eaca102-d99f-4fe8-b952-7d6551452ac6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:32.074782 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5eaca102-d99f-4fe8-b952-7d6551452ac6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:32.075265 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-5eaca102-d99f-4fe8-b952-7d6551452ac6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:32.210276 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-5eaca102-d99f-4fe8-b952-7d6551452ac6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:32.217659 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-5eaca102-d99f-4fe8-b952-7d6551452ac6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1319 microversion: 2.1 time: 0.155446 Jun 16 00:43:32.218225 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 584/1186] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:32 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:33.234219 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-8b229555-dc75-4e98-8980-e9e26a3c4598 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:33.234826 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-8b229555-dc75-4e98-8980-e9e26a3c4598 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:33.241315 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8b229555-dc75-4e98-8980-e9e26a3c4598 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:33.241763 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8b229555-dc75-4e98-8980-e9e26a3c4598 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:33.242518 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8b229555-dc75-4e98-8980-e9e26a3c4598 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:33.242953 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-8b229555-dc75-4e98-8980-e9e26a3c4598 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:33.367161 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-8b229555-dc75-4e98-8980-e9e26a3c4598 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:33.374529 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-8b229555-dc75-4e98-8980-e9e26a3c4598 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1319 microversion: 2.1 time: 0.144138 Jun 16 00:43:33.375089 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 603/1187] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:33 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:34.104870 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-3a51faef-2e48-45bd-987b-24bfd7be214a req-81384316-a481-495d-b8aa-f1d92af54306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9308ad-1dba-4dbb-a4b0-439e3d236d43", "name": "network-vif-plugged", "status": "completed", "tag": "13a2e6ce-284c-4328-9986-6e67e531a2e9"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:43:34.115086 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-3a51faef-2e48-45bd-987b-24bfd7be214a req-81384316-a481-495d-b8aa-f1d92af54306 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:34.115653 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-3a51faef-2e48-45bd-987b-24bfd7be214a req-81384316-a481-495d-b8aa-f1d92af54306 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:34.127175 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-3a51faef-2e48-45bd-987b-24bfd7be214a req-81384316-a481-495d-b8aa-f1d92af54306 service nova] Creating event network-vif-plugged:13a2e6ce-284c-4328-9986-6e67e531a2e9 for instance ae9308ad-1dba-4dbb-a4b0-439e3d236d43 on hv-cinder-84327 Jun 16 00:43:34.132871 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-3a51faef-2e48-45bd-987b-24bfd7be214a req-81384316-a481-495d-b8aa-f1d92af54306 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031236 Jun 16 00:43:34.133991 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 585/1188] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:43:34.392185 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-98f1241c-7fde-410b-b33d-2faf1c33b783 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:34.392798 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-98f1241c-7fde-410b-b33d-2faf1c33b783 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:34.399838 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-98f1241c-7fde-410b-b33d-2faf1c33b783 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:34.400284 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-98f1241c-7fde-410b-b33d-2faf1c33b783 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:34.401057 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-98f1241c-7fde-410b-b33d-2faf1c33b783 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:34.401492 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-98f1241c-7fde-410b-b33d-2faf1c33b783 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:34.526172 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-98f1241c-7fde-410b-b33d-2faf1c33b783 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:34.533413 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-98f1241c-7fde-410b-b33d-2faf1c33b783 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1319 microversion: 2.1 time: 0.145198 Jun 16 00:43:34.534605 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 604/1189] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:34 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:35.551964 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-60039211-044e-466a-83ec-5d529e178cc4 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:35.552651 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-60039211-044e-466a-83ec-5d529e178cc4 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:35.559227 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60039211-044e-466a-83ec-5d529e178cc4 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:35.559701 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60039211-044e-466a-83ec-5d529e178cc4 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:35.560466 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60039211-044e-466a-83ec-5d529e178cc4 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:35.560908 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-60039211-044e-466a-83ec-5d529e178cc4 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:35.691255 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-60039211-044e-466a-83ec-5d529e178cc4 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:35.698658 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-60039211-044e-466a-83ec-5d529e178cc4 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1319 microversion: 2.1 time: 0.151556 Jun 16 00:43:35.699214 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 586/1190] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:35 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:36.714286 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b307a4bb-e7eb-48a9-aea9-d8052cb145b6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:36.714898 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b307a4bb-e7eb-48a9-aea9-d8052cb145b6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:36.717262 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:36.722451 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b307a4bb-e7eb-48a9-aea9-d8052cb145b6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:36.722930 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b307a4bb-e7eb-48a9-aea9-d8052cb145b6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:36.723716 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b307a4bb-e7eb-48a9-aea9-d8052cb145b6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:36.724139 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b307a4bb-e7eb-48a9-aea9-d8052cb145b6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:36.851720 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b307a4bb-e7eb-48a9-aea9-d8052cb145b6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:36.859045 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b307a4bb-e7eb-48a9-aea9-d8052cb145b6 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1507 microversion: 2.1 time: 0.148630 Jun 16 00:43:36.859601 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 605/1191] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:36 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:36.875682 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c25158a3-747c-4cc6-a070-d966db0c8aee tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4927af21-8ef6-4614-bb8e-71d73697624d", "device": "/dev/sdb"}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:43:36.876801 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c25158a3-747c-4cc6-a070-d966db0c8aee tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:36.879363 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:36.880167 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=6 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:36.887406 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c25158a3-747c-4cc6-a070-d966db0c8aee tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:36.887888 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c25158a3-747c-4cc6-a070-d966db0c8aee tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:36.888660 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c25158a3-747c-4cc6-a070-d966db0c8aee tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:36.889098 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c25158a3-747c-4cc6-a070-d966db0c8aee tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:37.133950 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c25158a3-747c-4cc6-a070-d966db0c8aee tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "POST /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262026 Jun 16 00:43:37.134648 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 587/1192] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jun 16 00:43:36 2022] POST /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:43:58.462959 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-ae2345dd-38fd-4c90-894c-a28e795efc8b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:58.463455 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-ae2345dd-38fd-4c90-894c-a28e795efc8b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:58.465391 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=14 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:58.466075 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=30 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:58.471879 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ae2345dd-38fd-4c90-894c-a28e795efc8b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:58.472321 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ae2345dd-38fd-4c90-894c-a28e795efc8b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:58.473071 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ae2345dd-38fd-4c90-894c-a28e795efc8b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:58.473500 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-ae2345dd-38fd-4c90-894c-a28e795efc8b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:58.557351 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.objects.instance [None req-ae2345dd-38fd-4c90-894c-a28e795efc8b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lazy-loading 'services' on Instance uuid ae9308ad-1dba-4dbb-a4b0-439e3d236d43 {{(pid=129466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:43:58.628678 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-ae2345dd-38fd-4c90-894c-a28e795efc8b tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43/os-volume_attachments/4927af21-8ef6-4614-bb8e-71d73697624d" status: 202 len: 0 microversion: 2.1 time: 0.169494 Jun 16 00:43:58.629279 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 606/1193] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jun 16 00:43:58 2022] DELETE /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43/os-volume_attachments/4927af21-8ef6-4614-bb8e-71d73697624d => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:43:59.737705 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:59.738633 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:59.743081 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ff89c0fe-21d9-4cb1-b4c1-507c09ea2feb tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:59.743711 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ff89c0fe-21d9-4cb1-b4c1-507c09ea2feb tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:59.752392 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ff89c0fe-21d9-4cb1-b4c1-507c09ea2feb tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:59.752837 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ff89c0fe-21d9-4cb1-b4c1-507c09ea2feb tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:59.753589 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ff89c0fe-21d9-4cb1-b4c1-507c09ea2feb tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:59.754018 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ff89c0fe-21d9-4cb1-b4c1-507c09ea2feb tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:59.779391 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ff89c0fe-21d9-4cb1-b4c1-507c09ea2feb tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Going to try to terminate instance {{(pid=129465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:43:59.853404 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ff89c0fe-21d9-4cb1-b4c1-507c09ea2feb tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 204 len: 0 microversion: 2.1 time: 0.116636 Jun 16 00:43:59.854027 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 588/1194] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:43:59 2022] DELETE /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:43:59.863253 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-d824ef37-e9e6-4dbd-acbe-d3d7d49fcd61 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:59.863997 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-d824ef37-e9e6-4dbd-acbe-d3d7d49fcd61 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:59.870226 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d824ef37-e9e6-4dbd-acbe-d3d7d49fcd61 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:59.870678 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d824ef37-e9e6-4dbd-acbe-d3d7d49fcd61 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:59.871442 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d824ef37-e9e6-4dbd-acbe-d3d7d49fcd61 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:59.871934 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-d824ef37-e9e6-4dbd-acbe-d3d7d49fcd61 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:00.006417 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-d824ef37-e9e6-4dbd-acbe-d3d7d49fcd61 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:00.013958 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-d824ef37-e9e6-4dbd-acbe-d3d7d49fcd61 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1513 microversion: 2.1 time: 0.155319 Jun 16 00:44:00.014521 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 607/1195] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:59 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:01.031389 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-87934801-747a-42b4-8d6d-bf62df361a5c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:01.032710 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-87934801-747a-42b4-8d6d-bf62df361a5c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:01.039102 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-87934801-747a-42b4-8d6d-bf62df361a5c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:01.039551 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-87934801-747a-42b4-8d6d-bf62df361a5c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:01.040343 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-87934801-747a-42b4-8d6d-bf62df361a5c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:01.040779 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-87934801-747a-42b4-8d6d-bf62df361a5c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:01.169057 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-87934801-747a-42b4-8d6d-bf62df361a5c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:01.176729 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-87934801-747a-42b4-8d6d-bf62df361a5c tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1513 microversion: 2.1 time: 0.149508 Jun 16 00:44:01.177295 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 589/1196] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:01 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:02.193514 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-4548a400-497d-4606-a534-32a9d3a53c45 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:02.194391 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-4548a400-497d-4606-a534-32a9d3a53c45 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:02.200778 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4548a400-497d-4606-a534-32a9d3a53c45 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:02.201223 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4548a400-497d-4606-a534-32a9d3a53c45 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:02.201985 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4548a400-497d-4606-a534-32a9d3a53c45 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:02.202417 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-4548a400-497d-4606-a534-32a9d3a53c45 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:02.335406 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-4548a400-497d-4606-a534-32a9d3a53c45 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a40d49410041928eb9ac2e14206c02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8a376cc31445ee913739e0d2e8eec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:02.343079 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-4548a400-497d-4606-a534-32a9d3a53c45 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 200 len: 1513 microversion: 2.1 time: 0.153407 Jun 16 00:44:02.343661 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 608/1197] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:02 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:02.623007 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-65efb3f2-7b8d-4b8a-8064-9bfde476bccd req-a7d73ebc-24ec-4435-89b1-bed4f86669fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9308ad-1dba-4dbb-a4b0-439e3d236d43", "name": "network-vif-deleted", "tag": "13a2e6ce-284c-4328-9986-6e67e531a2e9"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:44:02.632317 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-65efb3f2-7b8d-4b8a-8064-9bfde476bccd req-a7d73ebc-24ec-4435-89b1-bed4f86669fa service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:02.632758 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-65efb3f2-7b8d-4b8a-8064-9bfde476bccd req-a7d73ebc-24ec-4435-89b1-bed4f86669fa service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:02.643562 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-65efb3f2-7b8d-4b8a-8064-9bfde476bccd req-a7d73ebc-24ec-4435-89b1-bed4f86669fa service nova] Creating event network-vif-deleted:13a2e6ce-284c-4328-9986-6e67e531a2e9 for instance ae9308ad-1dba-4dbb-a4b0-439e3d236d43 on hv-cinder-84327 Jun 16 00:44:02.648356 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-65efb3f2-7b8d-4b8a-8064-9bfde476bccd req-a7d73ebc-24ec-4435-89b1-bed4f86669fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029294 Jun 16 00:44:02.649022 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 590/1198] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:44:03.360819 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1bbe3279-cb0f-45b8-80ba-3c8df13c5526 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:03.361422 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-1bbe3279-cb0f-45b8-80ba-3c8df13c5526 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] [instance: ae9308ad-1dba-4dbb-a4b0-439e3d236d43] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:03.368307 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1bbe3279-cb0f-45b8-80ba-3c8df13c5526 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:03.368757 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1bbe3279-cb0f-45b8-80ba-3c8df13c5526 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:03.369505 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1bbe3279-cb0f-45b8-80ba-3c8df13c5526 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:03.369934 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-1bbe3279-cb0f-45b8-80ba-3c8df13c5526 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:03.383255 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-1bbe3279-cb0f-45b8-80ba-3c8df13c5526 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] HTTP exception thrown: Instance ae9308ad-1dba-4dbb-a4b0-439e3d236d43 could not be found. Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1bbe3279-cb0f-45b8-80ba-3c8df13c5526 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Request method failure captured: Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 HTTP/1.1 Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnxeYwBcSXQ995tjs3AzRIe4pXbdn4iHzBnoTzqZVmWnmtp0K0fYyG9LPZ7lsWFFv94Wns-BzpK6MyvIW7Of6mNYrbgWVtCTsdYpBSwHV44zxoHW-dj-cBxlIyEEhhwH5u_FaJlapQL3B1BqP3bwOOmM8CgsBdjVMr_czfBXMeWpEUY Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: ff8a376cc31445ee913739e0d2e8eec2 Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1162408786 Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:44:03.384873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:44:03.386654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ff8a376cc31445ee913739e0d2e8eec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ff8a376cc31445ee913739e0d2e8eec2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ff8a376cc31445ee913739e0d2e8eec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ff8a376cc31445ee913739e0d2e8eec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:44:03.386654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-VolumesSnapshotTestJSON-1162408786 Jun 16 00:44:03.386654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: ff8a376cc31445ee913739e0d2e8eec2 Jun 16 00:44:03.386654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1162408786 Jun 16 00:44:03.386654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-VolumesSnapshotTestJSON-1162408786-project Jun 16 00:44:03.386654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:44:03.386654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:44:03.386654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: 19a40d49410041928eb9ac2e14206c02 Jun 16 00:44:03.386654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-VolumesSnapshotTestJSON-1162408786-project Jun 16 00:44:03.386654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:44:03.386654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance ae9308ad-1dba-4dbb-a4b0-439e3d236d43 could not be found. Jun 16 00:44:03.386654 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': 'ae9308ad-1dba-4dbb-a4b0-439e3d236d43'} Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae9308ad-1dba-4dbb-a4b0-439e3d236d43 could not be found. Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:44:03.387711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae9308ad-1dba-4dbb-a4b0-439e3d236d43 could not be found. Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae9308ad-1dba-4dbb-a4b0-439e3d236d43 could not be found. Jun 16 00:44:03.389473 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:44:03.390984 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-1bbe3279-cb0f-45b8-80ba-3c8df13c5526 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] Returning 404 to user: Instance ae9308ad-1dba-4dbb-a4b0-439e3d236d43 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:44:03.390984 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-1bbe3279-cb0f-45b8-80ba-3c8df13c5526 tempest-VolumesSnapshotTestJSON-1162408786 tempest-VolumesSnapshotTestJSON-1162408786-project] 10.222.0.44 "GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43" status: 404 len: 111 microversion: 2.1 time: 0.029347 Jun 16 00:44:03.390984 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 609/1199] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:03 2022] GET /compute/v2.1/servers/ae9308ad-1dba-4dbb-a4b0-439e3d236d43 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:44:41.425476 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:41.426227 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:41.430888 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1868050446", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1794881766", "security_groups": [{"name": "tempest-secgroup-smoke-596553076"}], "block_device_mapping_v2": [{"uuid": "fa39ba80-78ff-4179-999e-b4cee47bf055", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c76d405a-2e1d-4834-ac04-fe5df400b255"}]}} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:44:41.542324 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.network.neutron [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] validate_networks() for [('c76d405a-2e1d-4834-ac04-fe5df400b255', None, None, None, None, None)] {{(pid=129465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:44:41.902546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Flavor limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:44:41.902961 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Image limits 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:44:41.903452 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Flavor pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:44:41.903879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Image pref 0:0:0 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:44:41.904416 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.virt.hardware [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:44:41.913747 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:41.914189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:41.914973 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:41.915403 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:41.932073 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Getting quotas for project e0d870e67f68470988dd26ac7aef3fec. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:44:41.935955 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.quota [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Getting quotas for user c9f93af4621b4a9db098c299c9e32c20 and project e0d870e67f68470988dd26ac7aef3fec. Resources: {'cores', 'instances', 'ram'} {{(pid=129465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:44:41.992104 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Going to run 1 instances... {{(pid=129465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:44:41.994805 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa39ba80-78ff-4179-999e-b4cee47bf055',volume_size=None,volume_type=None)] {{(pid=129465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:44:42.117973 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-4094b23d-9b17-4476-948b-c90a0d47fcdc tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.694089 Jun 16 00:44:42.118616 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 591/1200] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jun 16 00:44:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:44:42.129219 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-11f754ff-2fac-491d-88b3-39081db274a9 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:42.129829 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-11f754ff-2fac-491d-88b3-39081db274a9 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:42.132181 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=8 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:42.132816 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:42.186531 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-11f754ff-2fac-491d-88b3-39081db274a9 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:42.193238 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-11f754ff-2fac-491d-88b3-39081db274a9 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1095 microversion: 2.1 time: 0.067975 Jun 16 00:44:42.193797 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 610/1201] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:42 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:42.777482 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:44:42.777719 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Thu Jun 16 00:44:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:44:43.210787 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-0bfcc3af-ad46-44fb-bfa7-2be3768b7442 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:43.212189 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-0bfcc3af-ad46-44fb-bfa7-2be3768b7442 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:43.219221 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0bfcc3af-ad46-44fb-bfa7-2be3768b7442 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:43.219799 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0bfcc3af-ad46-44fb-bfa7-2be3768b7442 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:43.220790 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0bfcc3af-ad46-44fb-bfa7-2be3768b7442 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:43.221226 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-0bfcc3af-ad46-44fb-bfa7-2be3768b7442 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:43.290479 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-0bfcc3af-ad46-44fb-bfa7-2be3768b7442 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:43.297999 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-0bfcc3af-ad46-44fb-bfa7-2be3768b7442 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1201 microversion: 2.1 time: 0.091591 Jun 16 00:44:43.298593 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 592/1202] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:43 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1201 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:44.315918 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-be4d5a79-c62c-4a59-bab3-f3ead55c95aa tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:44.316530 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-be4d5a79-c62c-4a59-bab3-f3ead55c95aa tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:44.323257 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-be4d5a79-c62c-4a59-bab3-f3ead55c95aa tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:44.323961 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-be4d5a79-c62c-4a59-bab3-f3ead55c95aa tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:44.324921 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-be4d5a79-c62c-4a59-bab3-f3ead55c95aa tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:44.325361 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-be4d5a79-c62c-4a59-bab3-f3ead55c95aa tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:44.470385 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-be4d5a79-c62c-4a59-bab3-f3ead55c95aa tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:44.478340 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-be4d5a79-c62c-4a59-bab3-f3ead55c95aa tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.166440 Jun 16 00:44:44.479283 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 611/1203] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:44 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:44.711860 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-b9ef613c-ea0a-41f9-9f5f-ea7a1506ecf7 req-9a4c987f-8eb9-4992-a453-ddcef5be892e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0599a8-8dab-4bd9-8bb2-22fa31e778d5", "tag": "4fcaa9ae-2942-4f3c-a7fa-24961e673cc6"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:44:44.720338 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-b9ef613c-ea0a-41f9-9f5f-ea7a1506ecf7 req-9a4c987f-8eb9-4992-a453-ddcef5be892e service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:44.720774 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-b9ef613c-ea0a-41f9-9f5f-ea7a1506ecf7 req-9a4c987f-8eb9-4992-a453-ddcef5be892e service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:44.733846 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-b9ef613c-ea0a-41f9-9f5f-ea7a1506ecf7 req-9a4c987f-8eb9-4992-a453-ddcef5be892e service nova] Creating event network-changed:4fcaa9ae-2942-4f3c-a7fa-24961e673cc6 for instance 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 on hv-cinder-84327 Jun 16 00:44:44.738953 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-b9ef613c-ea0a-41f9-9f5f-ea7a1506ecf7 req-9a4c987f-8eb9-4992-a453-ddcef5be892e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183087 Jun 16 00:44:44.739575 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 593/1204] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:44:45.494177 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-400beacf-4f48-4554-b51a-56f9127d2131 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:45.494780 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-400beacf-4f48-4554-b51a-56f9127d2131 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:45.501311 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-400beacf-4f48-4554-b51a-56f9127d2131 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:45.501752 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-400beacf-4f48-4554-b51a-56f9127d2131 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:45.502502 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-400beacf-4f48-4554-b51a-56f9127d2131 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:45.502930 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-400beacf-4f48-4554-b51a-56f9127d2131 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:45.627696 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-400beacf-4f48-4554-b51a-56f9127d2131 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:45.635408 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-400beacf-4f48-4554-b51a-56f9127d2131 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.145121 Jun 16 00:44:45.635991 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 612/1205] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:45 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:46.652346 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a911c129-d8da-4715-88a6-352b8a157567 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:46.653031 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a911c129-d8da-4715-88a6-352b8a157567 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:46.659655 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a911c129-d8da-4715-88a6-352b8a157567 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:46.660119 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a911c129-d8da-4715-88a6-352b8a157567 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:46.660871 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a911c129-d8da-4715-88a6-352b8a157567 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:46.661301 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a911c129-d8da-4715-88a6-352b8a157567 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:46.798770 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a911c129-d8da-4715-88a6-352b8a157567 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:46.807163 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a911c129-d8da-4715-88a6-352b8a157567 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.158942 Jun 16 00:44:46.807735 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 594/1206] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:46 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:47.824305 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-535a44d5-878a-4f27-b5ce-04b02be5c643 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:47.824921 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-535a44d5-878a-4f27-b5ce-04b02be5c643 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:47.831461 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-535a44d5-878a-4f27-b5ce-04b02be5c643 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:47.831943 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-535a44d5-878a-4f27-b5ce-04b02be5c643 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:47.832714 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-535a44d5-878a-4f27-b5ce-04b02be5c643 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:47.833151 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-535a44d5-878a-4f27-b5ce-04b02be5c643 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:47.958495 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-535a44d5-878a-4f27-b5ce-04b02be5c643 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:47.965840 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-535a44d5-878a-4f27-b5ce-04b02be5c643 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.146057 Jun 16 00:44:47.966398 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 613/1207] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:47 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:48.982331 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ef680336-c974-48b5-a608-0cb47c4a16ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:48.982926 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ef680336-c974-48b5-a608-0cb47c4a16ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:48.989307 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ef680336-c974-48b5-a608-0cb47c4a16ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:48.989746 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ef680336-c974-48b5-a608-0cb47c4a16ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:48.990494 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ef680336-c974-48b5-a608-0cb47c4a16ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:48.990939 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ef680336-c974-48b5-a608-0cb47c4a16ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:49.119717 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ef680336-c974-48b5-a608-0cb47c4a16ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:49.127063 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ef680336-c974-48b5-a608-0cb47c4a16ca tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.148581 Jun 16 00:44:49.127638 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 595/1208] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:48 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:50.144528 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-489af71e-616a-4c32-8b3e-38e2c75b0c56 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:50.145069 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-489af71e-616a-4c32-8b3e-38e2c75b0c56 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:50.151928 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-489af71e-616a-4c32-8b3e-38e2c75b0c56 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:50.152371 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-489af71e-616a-4c32-8b3e-38e2c75b0c56 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:50.153119 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-489af71e-616a-4c32-8b3e-38e2c75b0c56 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:50.153547 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-489af71e-616a-4c32-8b3e-38e2c75b0c56 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:50.279342 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-489af71e-616a-4c32-8b3e-38e2c75b0c56 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:50.286673 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-489af71e-616a-4c32-8b3e-38e2c75b0c56 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.146080 Jun 16 00:44:50.287222 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 614/1209] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:50 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:51.303207 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-6a75df5b-7043-47b3-bc2e-a47e6bbb9a84 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:51.303837 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-6a75df5b-7043-47b3-bc2e-a47e6bbb9a84 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:51.310581 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6a75df5b-7043-47b3-bc2e-a47e6bbb9a84 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:51.311031 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6a75df5b-7043-47b3-bc2e-a47e6bbb9a84 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:51.311819 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6a75df5b-7043-47b3-bc2e-a47e6bbb9a84 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:51.312247 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-6a75df5b-7043-47b3-bc2e-a47e6bbb9a84 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:51.441770 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-6a75df5b-7043-47b3-bc2e-a47e6bbb9a84 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:51.449196 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-6a75df5b-7043-47b3-bc2e-a47e6bbb9a84 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.149811 Jun 16 00:44:51.449751 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 596/1210] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:51 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:52.465733 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-eef9a4ed-fe81-43f1-9377-24a89077af34 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:52.466349 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-eef9a4ed-fe81-43f1-9377-24a89077af34 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:52.468739 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell0:SELECT=2 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:52.474467 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-eef9a4ed-fe81-43f1-9377-24a89077af34 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:52.474914 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-eef9a4ed-fe81-43f1-9377-24a89077af34 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:52.475713 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-eef9a4ed-fe81-43f1-9377-24a89077af34 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:52.476153 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-eef9a4ed-fe81-43f1-9377-24a89077af34 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:52.609345 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-eef9a4ed-fe81-43f1-9377-24a89077af34 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:52.616872 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-eef9a4ed-fe81-43f1-9377-24a89077af34 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.155425 Jun 16 00:44:52.617435 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 615/1211] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:52 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:44:53.635087 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-ebd7dff2-8148-40e8-892e-c2346e269817 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:53.635745 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-ebd7dff2-8148-40e8-892e-c2346e269817 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:53.637660 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=2 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:53.638313 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell0:SELECT=6 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:53.644515 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ebd7dff2-8148-40e8-892e-c2346e269817 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:53.644959 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ebd7dff2-8148-40e8-892e-c2346e269817 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:53.645720 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ebd7dff2-8148-40e8-892e-c2346e269817 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:53.646153 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-ebd7dff2-8148-40e8-892e-c2346e269817 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:53.771959 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-ebd7dff2-8148-40e8-892e-c2346e269817 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:53.779292 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-ebd7dff2-8148-40e8-892e-c2346e269817 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.148708 Jun 16 00:44:53.779889 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 597/1212] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:53 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:54.795794 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c0c0bb87-7de1-4b2f-a34e-1ec6b4047dbf tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:54.796400 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c0c0bb87-7de1-4b2f-a34e-1ec6b4047dbf tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:54.803009 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c0c0bb87-7de1-4b2f-a34e-1ec6b4047dbf tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:54.803454 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c0c0bb87-7de1-4b2f-a34e-1ec6b4047dbf tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:54.804251 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c0c0bb87-7de1-4b2f-a34e-1ec6b4047dbf tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:54.804713 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c0c0bb87-7de1-4b2f-a34e-1ec6b4047dbf tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:55.188278 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-c0c0bb87-7de1-4b2f-a34e-1ec6b4047dbf tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:55.195995 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c0c0bb87-7de1-4b2f-a34e-1ec6b4047dbf tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.403915 Jun 16 00:44:55.197087 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 616/1213] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:54 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:56.213260 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-3beed27c-5709-4155-b69c-6bd6f3e3c052 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:56.213870 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-3beed27c-5709-4155-b69c-6bd6f3e3c052 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:56.220370 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3beed27c-5709-4155-b69c-6bd6f3e3c052 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:56.220815 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3beed27c-5709-4155-b69c-6bd6f3e3c052 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:56.221573 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3beed27c-5709-4155-b69c-6bd6f3e3c052 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:56.222006 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-3beed27c-5709-4155-b69c-6bd6f3e3c052 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:56.348693 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-3beed27c-5709-4155-b69c-6bd6f3e3c052 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:56.356379 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-3beed27c-5709-4155-b69c-6bd6f3e3c052 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.147391 Jun 16 00:44:56.356950 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 598/1214] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:56 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:56.551749 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [req-005474c8-91e9-4e6a-a85f-ce48276e6a41 req-6e27e4b5-694e-47a7-9952-118b795c4c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0599a8-8dab-4bd9-8bb2-22fa31e778d5", "name": "network-vif-plugged", "status": "completed", "tag": "4fcaa9ae-2942-4f3c-a7fa-24961e673cc6"}]} {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:44:56.559789 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-005474c8-91e9-4e6a-a85f-ce48276e6a41 req-6e27e4b5-694e-47a7-9952-118b795c4c0c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:56.560233 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [req-005474c8-91e9-4e6a-a85f-ce48276e6a41 req-6e27e4b5-694e-47a7-9952-118b795c4c0c service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:56.571651 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.compute.server_external_events [req-005474c8-91e9-4e6a-a85f-ce48276e6a41 req-6e27e4b5-694e-47a7-9952-118b795c4c0c service nova] Creating event network-vif-plugged:4fcaa9ae-2942-4f3c-a7fa-24961e673cc6 for instance 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 on hv-cinder-84327 Jun 16 00:44:56.576577 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [req-005474c8-91e9-4e6a-a85f-ce48276e6a41 req-6e27e4b5-694e-47a7-9952-118b795c4c0c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087837 Jun 16 00:44:56.577210 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 617/1215] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:44:57.372834 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-dd82f52b-f17d-4913-a210-a838645b5a75 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:57.373461 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-dd82f52b-f17d-4913-a210-a838645b5a75 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:57.380588 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dd82f52b-f17d-4913-a210-a838645b5a75 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:57.381028 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dd82f52b-f17d-4913-a210-a838645b5a75 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:57.381814 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dd82f52b-f17d-4913-a210-a838645b5a75 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:57.382244 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-dd82f52b-f17d-4913-a210-a838645b5a75 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:57.513048 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-dd82f52b-f17d-4913-a210-a838645b5a75 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:57.520490 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-dd82f52b-f17d-4913-a210-a838645b5a75 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.151549 Jun 16 00:44:57.521046 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 599/1216] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:57 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:58.539705 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2467a0cb-3675-45aa-97fa-8cb5cc2f50da tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:58.540389 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2467a0cb-3675-45aa-97fa-8cb5cc2f50da tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:58.547057 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2467a0cb-3675-45aa-97fa-8cb5cc2f50da tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:58.547502 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2467a0cb-3675-45aa-97fa-8cb5cc2f50da tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:58.548310 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2467a0cb-3675-45aa-97fa-8cb5cc2f50da tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:58.548745 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2467a0cb-3675-45aa-97fa-8cb5cc2f50da tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:58.684005 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-2467a0cb-3675-45aa-97fa-8cb5cc2f50da tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:58.691490 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2467a0cb-3675-45aa-97fa-8cb5cc2f50da tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1266 microversion: 2.1 time: 0.156465 Jun 16 00:44:58.692167 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 618/1217] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:58 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:59.708315 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-c83ec8e3-f043-4066-9de7-b2cab23823b6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:59.708928 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-c83ec8e3-f043-4066-9de7-b2cab23823b6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:59.715416 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c83ec8e3-f043-4066-9de7-b2cab23823b6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:59.715904 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c83ec8e3-f043-4066-9de7-b2cab23823b6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:59.716672 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c83ec8e3-f043-4066-9de7-b2cab23823b6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:59.717113 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-c83ec8e3-f043-4066-9de7-b2cab23823b6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:59.847814 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-c83ec8e3-f043-4066-9de7-b2cab23823b6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:59.855236 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-c83ec8e3-f043-4066-9de7-b2cab23823b6 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1453 microversion: 2.1 time: 0.150846 Jun 16 00:44:59.855839 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 600/1218] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:59 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:59.871324 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-716ab661-5122-422e-aa20-8cb472ad7ee3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:59.871954 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-716ab661-5122-422e-aa20-8cb472ad7ee3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:59.878287 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-716ab661-5122-422e-aa20-8cb472ad7ee3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:59.878734 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-716ab661-5122-422e-aa20-8cb472ad7ee3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:59.879849 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-716ab661-5122-422e-aa20-8cb472ad7ee3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:59.880284 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-716ab661-5122-422e-aa20-8cb472ad7ee3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:00.006844 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-716ab661-5122-422e-aa20-8cb472ad7ee3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:00.014327 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-716ab661-5122-422e-aa20-8cb472ad7ee3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1453 microversion: 2.1 time: 0.147281 Jun 16 00:45:00.014882 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 619/1219] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:59 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:01.653212 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-def41af4-431c-40d9-978f-8629c200ea84 req-d3352235-1ac9-400f-8c42-e3f4f123f055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0599a8-8dab-4bd9-8bb2-22fa31e778d5", "tag": "4fcaa9ae-2942-4f3c-a7fa-24961e673cc6"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:45:01.661565 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-def41af4-431c-40d9-978f-8629c200ea84 req-d3352235-1ac9-400f-8c42-e3f4f123f055 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:01.662009 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-def41af4-431c-40d9-978f-8629c200ea84 req-d3352235-1ac9-400f-8c42-e3f4f123f055 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:01.675284 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-def41af4-431c-40d9-978f-8629c200ea84 req-d3352235-1ac9-400f-8c42-e3f4f123f055 service nova] Creating event network-changed:4fcaa9ae-2942-4f3c-a7fa-24961e673cc6 for instance 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 on hv-cinder-84327 Jun 16 00:45:01.680235 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-def41af4-431c-40d9-978f-8629c200ea84 req-d3352235-1ac9-400f-8c42-e3f4f123f055 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030816 Jun 16 00:45:01.680841 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 601/1220] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:45:01.987648 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:45:01.987879 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Thu Jun 16 00:45:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:46:51.467724 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_api:SELECT=22 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:51.469621 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1cc99b01-0c72-4616-9a55-9ac32c7b2929] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 00:46:51.470056 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG dbcounter [-] [129466] Writing DB stats nova_cell1:SELECT=50 {{(pid=129466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:51.470159 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:51.470673 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG dbcounter [-] [129465] Writing DB stats nova_cell1:SELECT=54 {{(pid=129465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:51.473885 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-c9eae5e7-dccc-4762-a749-33e18d8d33b3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:51.474565 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c9eae5e7-dccc-4762-a749-33e18d8d33b3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:51.475327 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-7750f7f6-9d86-449b-bd1f-b7779e2ccbfb req-95b1dc08-d9e2-4e13-9544-a6a2e1dba5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0599a8-8dab-4bd9-8bb2-22fa31e778d5", "tag": "4fcaa9ae-2942-4f3c-a7fa-24961e673cc6"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:46:51.481711 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c9eae5e7-dccc-4762-a749-33e18d8d33b3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:51.482160 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c9eae5e7-dccc-4762-a749-33e18d8d33b3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:51.482940 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c9eae5e7-dccc-4762-a749-33e18d8d33b3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:51.483372 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-c9eae5e7-dccc-4762-a749-33e18d8d33b3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:51.484202 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-7750f7f6-9d86-449b-bd1f-b7779e2ccbfb req-95b1dc08-d9e2-4e13-9544-a6a2e1dba5c0 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:51.484647 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-7750f7f6-9d86-449b-bd1f-b7779e2ccbfb req-95b1dc08-d9e2-4e13-9544-a6a2e1dba5c0 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:51.498053 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-7750f7f6-9d86-449b-bd1f-b7779e2ccbfb req-95b1dc08-d9e2-4e13-9544-a6a2e1dba5c0 service nova] Creating event network-changed:4fcaa9ae-2942-4f3c-a7fa-24961e673cc6 for instance 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 on hv-cinder-84327 Jun 16 00:46:51.503103 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-7750f7f6-9d86-449b-bd1f-b7779e2ccbfb req-95b1dc08-d9e2-4e13-9544-a6a2e1dba5c0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035378 Jun 16 00:46:51.503926 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 602/1221] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:46:51.512991 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-c9eae5e7-dccc-4762-a749-33e18d8d33b3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Going to try to terminate instance {{(pid=129466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:46:51.606138 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-c9eae5e7-dccc-4762-a749-33e18d8d33b3 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 204 len: 0 microversion: 2.1 time: 0.140424 Jun 16 00:46:51.606909 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 620/1222] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:46:51 2022] DELETE /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:46:51.616605 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-a6b88cf9-f6af-47bd-b559-f769487265de tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:51.617303 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-a6b88cf9-f6af-47bd-b559-f769487265de tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:51.623863 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a6b88cf9-f6af-47bd-b559-f769487265de tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:51.624562 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a6b88cf9-f6af-47bd-b559-f769487265de tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:51.625543 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a6b88cf9-f6af-47bd-b559-f769487265de tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:51.626303 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-a6b88cf9-f6af-47bd-b559-f769487265de tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:51.818844 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-a6b88cf9-f6af-47bd-b559-f769487265de tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:46:51.826500 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-a6b88cf9-f6af-47bd-b559-f769487265de tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1578 microversion: 2.1 time: 0.214575 Jun 16 00:46:51.827068 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 603/1223] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:51 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1578 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:46:52.843789 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-bf8c24d1-fc12-46ee-960b-1ca585a5360b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:52.844484 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-bf8c24d1-fc12-46ee-960b-1ca585a5360b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:52.851046 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bf8c24d1-fc12-46ee-960b-1ca585a5360b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:52.851486 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bf8c24d1-fc12-46ee-960b-1ca585a5360b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:52.852293 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bf8c24d1-fc12-46ee-960b-1ca585a5360b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:52.852712 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-bf8c24d1-fc12-46ee-960b-1ca585a5360b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:53.036420 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-bf8c24d1-fc12-46ee-960b-1ca585a5360b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:46:53.044386 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-bf8c24d1-fc12-46ee-960b-1ca585a5360b tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1578 microversion: 2.1 time: 0.204602 Jun 16 00:46:53.045247 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 621/1224] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:52 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1578 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:46:53.914984 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-093dfbf3-402f-4e05-81a7-2e2a113c9a80 req-794bf730-a927-41fb-8aa8-4931db4ef345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0599a8-8dab-4bd9-8bb2-22fa31e778d5", "name": "network-vif-deleted", "tag": "4fcaa9ae-2942-4f3c-a7fa-24961e673cc6"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:46:53.924969 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-093dfbf3-402f-4e05-81a7-2e2a113c9a80 req-794bf730-a927-41fb-8aa8-4931db4ef345 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:53.925417 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-093dfbf3-402f-4e05-81a7-2e2a113c9a80 req-794bf730-a927-41fb-8aa8-4931db4ef345 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:53.936919 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-093dfbf3-402f-4e05-81a7-2e2a113c9a80 req-794bf730-a927-41fb-8aa8-4931db4ef345 service nova] Creating event network-vif-deleted:4fcaa9ae-2942-4f3c-a7fa-24961e673cc6 for instance 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 on hv-cinder-84327 Jun 16 00:46:53.942128 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-093dfbf3-402f-4e05-81a7-2e2a113c9a80 req-794bf730-a927-41fb-8aa8-4931db4ef345 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031333 Jun 16 00:46:53.942712 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 604/1225] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:46:54.062012 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-b1afcb27-409e-4967-86d2-b2813e9c9e99 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:54.062554 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-b1afcb27-409e-4967-86d2-b2813e9c9e99 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:54.069419 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b1afcb27-409e-4967-86d2-b2813e9c9e99 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:54.069861 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b1afcb27-409e-4967-86d2-b2813e9c9e99 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:54.070612 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b1afcb27-409e-4967-86d2-b2813e9c9e99 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:54.071049 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-b1afcb27-409e-4967-86d2-b2813e9c9e99 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:54.133610 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-b1afcb27-409e-4967-86d2-b2813e9c9e99 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:46:54.141044 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-b1afcb27-409e-4967-86d2-b2813e9c9e99 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 200 len: 1226 microversion: 2.1 time: 0.082893 Jun 16 00:46:54.141604 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 622/1226] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:54 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:46:55.159851 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2ca5c20e-0854-442f-9650-46a675b3174d tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:55.160573 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-2ca5c20e-0854-442f-9650-46a675b3174d tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:55.163311 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO oslo.messaging._drivers.impl_rabbit [-] [1cc99b01-0c72-4616-9a55-9ac32c7b2929] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 42840. Jun 16 00:46:55.168314 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2ca5c20e-0854-442f-9650-46a675b3174d tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:55.168764 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2ca5c20e-0854-442f-9650-46a675b3174d tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:55.169527 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2ca5c20e-0854-442f-9650-46a675b3174d tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:55.169966 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-2ca5c20e-0854-442f-9650-46a675b3174d tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:55.182866 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-2ca5c20e-0854-442f-9650-46a675b3174d tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] HTTP exception thrown: Instance 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 could not be found. Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2ca5c20e-0854-442f-9650-46a675b3174d tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Request method failure captured: Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 HTTP/1.1 Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnuOm9s92YYhb_jYOtONR4QLHSjvosqt6zjWKgEhm6lR7bLiG-fS4yjF6957JhB9Dp9C_6NyyWP3Eedu_I0IOp1_PBNwz8V2EJnUGIzpJ1RjCZIant94teA2QJp3Y1xhTWnwoeSNOgSLJvN2i4rYCrPZMj43sxr2cY6byfFAMs8Mtbo Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: e0d870e67f68470988dd26ac7aef3fec Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-TestVolumeBootPattern-34596046 Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:46:55.184511 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:46:55.186090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:46:55.186090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-TestVolumeBootPattern-34596046 Jun 16 00:46:55.186090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: e0d870e67f68470988dd26ac7aef3fec Jun 16 00:46:55.186090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-TestVolumeBootPattern-34596046 Jun 16 00:46:55.186090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-TestVolumeBootPattern-34596046-project Jun 16 00:46:55.186090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:46:55.186090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:46:55.186090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: c9f93af4621b4a9db098c299c9e32c20 Jun 16 00:46:55.186090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-TestVolumeBootPattern-34596046-project Jun 16 00:46:55.186090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:46:55.186090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 could not be found. Jun 16 00:46:55.186090 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '7c0599a8-8dab-4bd9-8bb2-22fa31e778d5'} Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 could not be found. Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:46:55.187019 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 could not be found. Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 could not be found. Jun 16 00:46:55.188975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:46:55.191490 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-2ca5c20e-0854-442f-9650-46a675b3174d tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Returning 404 to user: Instance 7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:46:55.191490 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-2ca5c20e-0854-442f-9650-46a675b3174d tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5" status: 404 len: 111 microversion: 2.1 time: 0.030302 Jun 16 00:46:55.191490 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 605/1227] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:55 2022] GET /compute/v2.1/servers/7c0599a8-8dab-4bd9-8bb2-22fa31e778d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:46:58.427634 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-77130f9b-7389-40d9-b994-e498b4898b60 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:58.428765 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-77130f9b-7389-40d9-b994-e498b4898b60 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:58.429097 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-bfc35c8e-93be-48eb-a1ef-f8884b4d8625 req-67bf8e6d-5b5b-47b6-afe9-5b87eea1edf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ca7fdf2-0f00-4e8a-9521-98dcd57c5219", "tag": "26f5e2a7-f5fa-4003-a9df-46464649afd5"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:46:58.435413 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-77130f9b-7389-40d9-b994-e498b4898b60 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:58.435901 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-77130f9b-7389-40d9-b994-e498b4898b60 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:58.436669 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-77130f9b-7389-40d9-b994-e498b4898b60 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:58.437163 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-77130f9b-7389-40d9-b994-e498b4898b60 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:58.439551 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-bfc35c8e-93be-48eb-a1ef-f8884b4d8625 req-67bf8e6d-5b5b-47b6-afe9-5b87eea1edf5 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:58.440236 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-bfc35c8e-93be-48eb-a1ef-f8884b4d8625 req-67bf8e6d-5b5b-47b6-afe9-5b87eea1edf5 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:58.452187 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-bfc35c8e-93be-48eb-a1ef-f8884b4d8625 req-67bf8e6d-5b5b-47b6-afe9-5b87eea1edf5 service nova] Creating event network-changed:26f5e2a7-f5fa-4003-a9df-46464649afd5 for instance 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 on hv-cinder-84327 Jun 16 00:46:58.458056 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-bfc35c8e-93be-48eb-a1ef-f8884b4d8625 req-67bf8e6d-5b5b-47b6-afe9-5b87eea1edf5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033078 Jun 16 00:46:58.459828 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 606/1228] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:46:58.464465 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-77130f9b-7389-40d9-b994-e498b4898b60 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Going to try to terminate instance {{(pid=129466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:46:58.552331 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-77130f9b-7389-40d9-b994-e498b4898b60 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 204 len: 0 microversion: 2.1 time: 0.129580 Jun 16 00:46:58.552924 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 623/1229] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:46:58 2022] DELETE /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:46:58.562964 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-8d94737e-e41b-4207-bb8f-bbaf878e1801 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:58.563781 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-8d94737e-e41b-4207-bb8f-bbaf878e1801 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:58.570519 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8d94737e-e41b-4207-bb8f-bbaf878e1801 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:58.570975 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8d94737e-e41b-4207-bb8f-bbaf878e1801 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:58.571804 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8d94737e-e41b-4207-bb8f-bbaf878e1801 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:58.572247 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-8d94737e-e41b-4207-bb8f-bbaf878e1801 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:58.708399 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.policy [None req-8d94737e-e41b-4207-bb8f-bbaf878e1801 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129465) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:46:58.716018 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-8d94737e-e41b-4207-bb8f-bbaf878e1801 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1577 microversion: 2.1 time: 0.157619 Jun 16 00:46:58.716589 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 607/1230] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:58 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:46:59.734218 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-a33ae976-9120-452f-921e-29539ab4af58 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:59.735755 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-a33ae976-9120-452f-921e-29539ab4af58 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:59.742599 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a33ae976-9120-452f-921e-29539ab4af58 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:59.743061 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a33ae976-9120-452f-921e-29539ab4af58 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:59.743873 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a33ae976-9120-452f-921e-29539ab4af58 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:59.744317 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-a33ae976-9120-452f-921e-29539ab4af58 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:59.874316 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-a33ae976-9120-452f-921e-29539ab4af58 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:46:59.882147 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-a33ae976-9120-452f-921e-29539ab4af58 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1577 microversion: 2.1 time: 0.151928 Jun 16 00:46:59.882738 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 624/1231] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:59 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:00.634501 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [req-1f853780-1872-43df-a9eb-3bf378968243 req-aec441be-0589-4160-a634-fffa3891a753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ca7fdf2-0f00-4e8a-9521-98dcd57c5219", "name": "network-vif-deleted", "tag": "26f5e2a7-f5fa-4003-a9df-46464649afd5"}]} {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:47:00.644175 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-1f853780-1872-43df-a9eb-3bf378968243 req-aec441be-0589-4160-a634-fffa3891a753 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:00.644649 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [req-1f853780-1872-43df-a9eb-3bf378968243 req-aec441be-0589-4160-a634-fffa3891a753 service nova] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:00.655645 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.compute.server_external_events [req-1f853780-1872-43df-a9eb-3bf378968243 req-aec441be-0589-4160-a634-fffa3891a753 service nova] Creating event network-vif-deleted:26f5e2a7-f5fa-4003-a9df-46464649afd5 for instance 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 on hv-cinder-84327 Jun 16 00:47:00.660323 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [req-1f853780-1872-43df-a9eb-3bf378968243 req-aec441be-0589-4160-a634-fffa3891a753 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030389 Jun 16 00:47:00.660913 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 608/1232] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jun 16 00:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:47:00.899364 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-f255aeb7-d426-4697-80a6-8f08536028e0 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:00.900661 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-f255aeb7-d426-4697-80a6-8f08536028e0 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:00.907044 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f255aeb7-d426-4697-80a6-8f08536028e0 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:00.907747 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f255aeb7-d426-4697-80a6-8f08536028e0 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:00.908519 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f255aeb7-d426-4697-80a6-8f08536028e0 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:00.908960 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-f255aeb7-d426-4697-80a6-8f08536028e0 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:00.981038 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.policy [None req-f255aeb7-d426-4697-80a6-8f08536028e0 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9f93af4621b4a9db098c299c9e32c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d870e67f68470988dd26ac7aef3fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129466) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:00.989091 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-f255aeb7-d426-4697-80a6-8f08536028e0 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 200 len: 1226 microversion: 2.1 time: 0.093848 Jun 16 00:47:00.989678 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 625/1233] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:00 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:02.009668 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-adad52a8-5080-4992-bfe5-0a640b7d0ccd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:02.010289 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-adad52a8-5080-4992-bfe5-0a640b7d0ccd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:02.016502 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-adad52a8-5080-4992-bfe5-0a640b7d0ccd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:02.016953 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-adad52a8-5080-4992-bfe5-0a640b7d0ccd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:02.017717 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-adad52a8-5080-4992-bfe5-0a640b7d0ccd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:02.018150 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-adad52a8-5080-4992-bfe5-0a640b7d0ccd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:02.031074 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-adad52a8-5080-4992-bfe5-0a640b7d0ccd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] HTTP exception thrown: Instance 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 could not be found. Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-adad52a8-5080-4992-bfe5-0a640b7d0ccd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Request method failure captured: Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 HTTP/1.1 Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnuOm9s92YYhb_jYOtONR4QLHSjvosqt6zjWKgEhm6lR7bLiG-fS4yjF6957JhB9Dp9C_6NyyWP3Eedu_I0IOp1_PBNwz8V2EJnUGIzpJ1RjCZIant94teA2QJp3Y1xhTWnwoeSNOgSLJvN2i4rYCrPZMj43sxr2cY6byfFAMs8Mtbo Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: e0d870e67f68470988dd26ac7aef3fec Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-TestVolumeBootPattern-34596046 Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:47:02.032690 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:47:02.034546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:47:02.034546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-TestVolumeBootPattern-34596046 Jun 16 00:47:02.034546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: e0d870e67f68470988dd26ac7aef3fec Jun 16 00:47:02.034546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-TestVolumeBootPattern-34596046 Jun 16 00:47:02.034546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-TestVolumeBootPattern-34596046-project Jun 16 00:47:02.034546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:47:02.034546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:47:02.034546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: c9f93af4621b4a9db098c299c9e32c20 Jun 16 00:47:02.034546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-TestVolumeBootPattern-34596046-project Jun 16 00:47:02.034546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:47:02.034546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 could not be found. Jun 16 00:47:02.034546 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': '5ca7fdf2-0f00-4e8a-9521-98dcd57c5219'} Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 could not be found. Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:47:02.035595 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 could not be found. Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 could not be found. Jun 16 00:47:02.037465 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.038930 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-adad52a8-5080-4992-bfe5-0a640b7d0ccd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Returning 404 to user: Instance 5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:47:02.038930 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-adad52a8-5080-4992-bfe5-0a640b7d0ccd tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219" status: 404 len: 111 microversion: 2.1 time: 0.030182 Jun 16 00:47:02.038930 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 609/1234] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:02 2022] GET /compute/v2.1/servers/5ca7fdf2-0f00-4e8a-9521-98dcd57c5219 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:47:02.473834 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2a931754-4719-4793-90d5-60bc4c46c92c tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:02.474314 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.compute.api [None req-2a931754-4719-4793-90d5-60bc4c46c92c tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129466) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:02.481393 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2a931754-4719-4793-90d5-60bc4c46c92c tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:02.481835 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2a931754-4719-4793-90d5-60bc4c46c92c tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:02.482617 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2a931754-4719-4793-90d5-60bc4c46c92c tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:02.483047 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG oslo_concurrency.lockutils [None req-2a931754-4719-4793-90d5-60bc4c46c92c tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:02.496450 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.wsgi [None req-2a931754-4719-4793-90d5-60bc4c46c92c tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] HTTP exception thrown: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2a931754-4719-4793-90d5-60bc4c46c92c tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Request method failure captured: Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: request: DELETE /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 HTTP/1.1 Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept: application/json Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Accept-Encoding: identity Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Connection: close Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Length: 0 Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Content-Type: application/json Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Host: 10.222.0.44 Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Openstack-System-Scope: None Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: User-Agent: python-urllib3/1.26.9 Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Auth-Token: gAAAAABiqnuOm9s92YYhb_jYOtONR4QLHSjvosqt6zjWKgEhm6lR7bLiG-fS4yjF6957JhB9Dp9C_6NyyWP3Eedu_I0IOp1_PBNwz8V2EJnUGIzpJ1RjCZIant94teA2QJp3Y1xhTWnwoeSNOgSLJvN2i4rYCrPZMj43sxr2cY6byfFAMs8Mtbo Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Id: None Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Domain-Name: None Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Identity-Status: Confirmed Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Is-Admin-Project: True Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Id: default Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Domain-Name: Default Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Id: e0d870e67f68470988dd26ac7aef3fec Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Project-Name: tempest-TestVolumeBootPattern-34596046 Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Role: reader,member Jun 16 00:47:02.498034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Roles: reader,member Jun 16 00:47:02.501034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:47:02.501034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant: tempest-TestVolumeBootPattern-34596046 Jun 16 00:47:02.501034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Id: e0d870e67f68470988dd26ac7aef3fec Jun 16 00:47:02.501034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-Tenant-Name: tempest-TestVolumeBootPattern-34596046 Jun 16 00:47:02.501034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User: tempest-TestVolumeBootPattern-34596046-project Jun 16 00:47:02.501034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Id: default Jun 16 00:47:02.501034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Domain-Name: Default Jun 16 00:47:02.501034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Id: c9f93af4621b4a9db098c299c9e32c20 Jun 16 00:47:02.501034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: X-User-Name: tempest-TestVolumeBootPattern-34596046-project Jun 16 00:47:02.501034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: method: > Jun 16 00:47:02.501034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: exception: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:47:02.501034 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: action_args: {'id': 'd4813890-4093-4866-b4c6-fbbbed962872'} Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:47:02.501942 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:47:02.503569 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.505353 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-2a931754-4719-4793-90d5-60bc4c46c92c tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Returning 404 to user: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. {{(pid=129466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:47:02.505353 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-2a931754-4719-4793-90d5-60bc4c46c92c tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 404 len: 111 microversion: 2.1 time: 0.029467 Jun 16 00:47:02.505353 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 626/1235] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jun 16 00:47:02 2022] DELETE /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:47:02.508304 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9bc39cb0-73ea-4ab9-b967-752206105b08 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '>' {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:02.508928 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.compute.api [None req-9bc39cb0-73ea-4ab9-b967-752206105b08 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] [instance: d4813890-4093-4866-b4c6-fbbbed962872] Fetching instance by UUID {{(pid=129465) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:02.514938 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9bc39cb0-73ea-4ab9-b967-752206105b08 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:02.515388 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9bc39cb0-73ea-4ab9-b967-752206105b08 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:02.516177 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9bc39cb0-73ea-4ab9-b967-752206105b08 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:02.516613 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG oslo_concurrency.lockutils [None req-9bc39cb0-73ea-4ab9-b967-752206105b08 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Lock "7f03a406-cd78-4a9a-b33f-da67f6bff5f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:02.529602 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.wsgi [None req-9bc39cb0-73ea-4ab9-b967-752206105b08 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] HTTP exception thrown: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9bc39cb0-73ea-4ab9-b967-752206105b08 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Request method failure captured: Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: request: GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 HTTP/1.1 Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept: application/json Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Accept-Encoding: identity Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Connection: close Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Length: 0 Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Content-Type: application/json Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Host: 10.222.0.44 Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Openstack-System-Scope: None Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: User-Agent: python-urllib3/1.26.9 Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Auth-Token: gAAAAABiqnuOm9s92YYhb_jYOtONR4QLHSjvosqt6zjWKgEhm6lR7bLiG-fS4yjF6957JhB9Dp9C_6NyyWP3Eedu_I0IOp1_PBNwz8V2EJnUGIzpJ1RjCZIant94teA2QJp3Y1xhTWnwoeSNOgSLJvN2i4rYCrPZMj43sxr2cY6byfFAMs8Mtbo Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Id: None Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Domain-Name: None Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Identity-Status: Confirmed Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Is-Admin-Project: True Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Id: default Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Domain-Name: Default Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Id: e0d870e67f68470988dd26ac7aef3fec Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Project-Name: tempest-TestVolumeBootPattern-34596046 Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Role: reader,member Jun 16 00:47:02.531096 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Roles: reader,member Jun 16 00:47:02.532885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e0d870e67f68470988dd26ac7aef3fec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 16 00:47:02.532885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant: tempest-TestVolumeBootPattern-34596046 Jun 16 00:47:02.532885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Id: e0d870e67f68470988dd26ac7aef3fec Jun 16 00:47:02.532885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-Tenant-Name: tempest-TestVolumeBootPattern-34596046 Jun 16 00:47:02.532885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User: tempest-TestVolumeBootPattern-34596046-project Jun 16 00:47:02.532885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Id: default Jun 16 00:47:02.532885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Domain-Name: Default Jun 16 00:47:02.532885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Id: c9f93af4621b4a9db098c299c9e32c20 Jun 16 00:47:02.532885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: X-User-Name: tempest-TestVolumeBootPattern-34596046-project Jun 16 00:47:02.532885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: method: > Jun 16 00:47:02.532885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: exception: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:47:02.532885 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: action_args: {'id': 'd4813890-4093-4866-b4c6-fbbbed962872'} Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: {{(pid=129465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:47:02.533931 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. Jun 16 00:47:02.535545 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: ERROR nova.api.openstack.wsgi Jun 16 00:47:02.537134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: DEBUG nova.api.openstack.wsgi [None req-9bc39cb0-73ea-4ab9-b967-752206105b08 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Returning 404 to user: Instance d4813890-4093-4866-b4c6-fbbbed962872 could not be found. {{(pid=129465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:47:02.537134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO nova.api.openstack.requestlog [None req-9bc39cb0-73ea-4ab9-b967-752206105b08 tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872" status: 404 len: 111 microversion: 2.1 time: 0.028396 Jun 16 00:47:02.537134 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: [pid: 129465|app: 0|req: 610/1236] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:02 2022] GET /compute/v2.1/servers/d4813890-4093-4866-b4c6-fbbbed962872 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:47:03.819501 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: DEBUG nova.api.openstack.wsgi [None req-859a1cf5-dedf-4eb7-9489-4b9ea32fc7ae tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] Calling method '.version_select at 0x7f9573dd7790>' {{(pid=129466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:03.842336 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO nova.api.openstack.requestlog [None req-859a1cf5-dedf-4eb7-9489-4b9ea32fc7ae tempest-TestVolumeBootPattern-34596046 tempest-TestVolumeBootPattern-34596046-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1794881766" status: 202 len: 0 microversion: 2.1 time: 0.026678 Jun 16 00:47:03.843282 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: [pid: 129466|app: 0|req: 627/1237] 10.222.0.44 () {58 vars in 1262 bytes} [Thu Jun 16 00:47:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1794881766 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:47:52.424032 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:47:52.424693 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Thu Jun 16 00:47:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:48:21.996992 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:48:21.997575 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Thu Jun 16 00:48:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:49:42.789494 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:49:42.790018 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Thu Jun 16 00:49:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:49:45.428942 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:49:45.429497 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Thu Jun 16 00:49:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:49:56.587484 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:49:56.588102 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Thu Jun 16 00:49:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:49:56.866235 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:49:56.866668 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Thu Jun 16 00:49:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:51:12.432155 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:51:12.432689 dv-cinder-843277-4-iscsi devstack@n-api.service[129466]: Thu Jun 16 00:51:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:51:42.006514 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:51:42.007054 dv-cinder-843277-4-iscsi devstack@n-api.service[129465]: Thu Jun 16 00:51:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!